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FOREWORD 

The Baldwin-Whitehall Public Schools of suburban Pittsburgh have 
been cooperating with institutions of education for many years. Our work 
with universities and colleges arises from our fundamental belief that 
innovations in education can most fruitfully develop from this kind of 
association. Tt is the important role of school boards and school admin- 
istrators to become alert to new educational developments and also to 
sensitize researchers to a school system's requirements for research and 
development • 

Duping the 1961-62 school year, the decision was made to study the 

* A £ > * 

effectivehess and impact of the new programmed instruction in our schools. 

* ^ 

A series of studies was instituted at all levels from elementary school 
through high school. However, only the work which we think will be of the 
most wide-spread interest is described in this report. In general, we 
learned some things about this new educational tool. Specifically, we 
found that the principles of programmed instruction were useful concepts, 
but that particular programmed Instructional materials have to be evaluated 
on the basis of their own merit, which is in fact a principle of the pro- 
grammed instructional procedure itself. 

Host significantly, the use of programmed instructional materials 
with their emphasis on individualized learning awakened within us the 
educator' 8 long-time goal of producing innovations in education that would 
permit a system which would be highly adaptable to individual student needs. 
We are pursuing this with the Learning Research and Development Center at 
the present time. As indicated in the Preface, the studies reported here 
served as a prelude for our present projects with the Center. 

In my role as Superintendent of the Baldwin-Whltehall School System, 
I must acknowledge those Individuals who particularly encourage a climate 




of innovation and who are particularly helpful in carrying out our contin- 
uing quest for quality in education. These people include Dr. J. Steele 
Gow, Jr., Dr. Warren D. Shepler, Dr. J. Ernest Harrison, Mr. Arthur D. 
Jeffries, and Mr. Howard F. Phillips. 

Dr. W. Robert Paynter 

Pittsburgh, Pennsylvania 
May, 1966 



% 

*♦ 



* 



*4 



PREFACE 



During the school year of 1963-64, the L aming Research and 
Development Center and the Baldwin-Whitehall Public Schools of suburban 
Pittsburgh initiated an experimental project to investigate the feasi- 
bility of a system of individualized Instruction in an entire K-6 school. 
This came about as a result of a series of prior exploratory studies, 
begun in 1961-62, designed to test preliminary notions on a smaller scale 
and in single classrooms. The work started with the use of programmed 
instruction in an intact classroom, the intact classroom being defined as 
a classroom unit in which the teaching practices were oriented around the 
conventional grade-by-grade progression of learning. 

As work proceeded, it soon became apparent that the significant 
individualization feature of programmed instruction could not be manifested 
unless the intact classroom changed its organization to permit a more 
flexible progression. As a result, a second set of studies was Instituted 
to use programed instruction and other materials in a more flexible con- 
text. Out of this experience grew tfr* Individually Prescribed Instruction 
Project currently in progress, in which various combinations of instruc- 
tional materials, including programmed materials, special workbook and 
test procedures, and teacher practices, are being used for the purpose of 
adapting to individual student requirements. 

Part One of this report describes the initial work on the use of 
programmed material in the Intact classrooms Chapter 1 describes specific 
studies in arithmetic and spelling; Chapter 2 describes the investigation 
of student variables such as attention, attitudes, and aptitude; and 
Chapter 3 describes a sociologist's study of some of the unanticipated 
consequences of an educational innovation on supervision, the teacher, and 
school organization. Part Two, which consists of Chapter 4, describes 

exploratory studies in the individualization of instruction in flexible 

/ 

classroom contexts. 





Primary acknowledgement for the completion of these studies goes 
to the Baldwin-Whitehall teaching staff and the principals of the various 
schools involved. Over the course of the studies, all of which are not 

reported here, more than fifty teachers and two thousand students partici- 
pated. 

Particular acknowledgement must go to the senior administrators of 
the Baldwin-Whitehall Public Schools: W, Robert Paynter, Superintendent, 

Warren D, Shepler, Assistant Superintendent in Charge of Instruction,* and 
J* Ernest Harrison, Director of Curriculum and Research,** The foresight 
of these men has been a constant source of encouragement for the work of 
the Center, 

Mr, Jack R, Fisher coordinated the conduct of the studies and data- 
collectlon procedures. He also supervised the writing of supplementary 
teacher materials and prepared preliminary drafts for the writing of this 
report. During 1961-62, Mr, Theodore A, Harakas monitored the conduct of 
the studies and contributed to analysis of the data. 



*Now Assistant: Superintendent of the Harrisburg Public Schools in 
Harrisburg , Pennsylvania « 

**Now Assistant Superintendent in Charge of Instruction of the 
Baldwin-Whitehall Public Schools, 
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GENERAL INTRODUCTION AND IMPLICATIONS 



The most useful Introduction to this report would seem to be a 
description of findings and observations which have broad implications for 
future studies on instructional procedures in the classroom* Details* 
specific data and elaboration of conclusions are to be found in the body 
of the text* The motivation behind the series of studies carried out was 
to examine student instruction and achievement in basic subjects taught 
largely by programmed instruction in the elementary school and to suggest 
what this examination might mean for the improvement of instructional 
practice and for the improvement of research methodology on classroom 
learning* The work presented in this report generally suggests the fol- 
lowing with respect to the student* the teacher* and research methodology* 

Student Learning and Achievement 

1* The student can obtain more information and knowledge than he 
presently obtains* When the time of a lesson period is kept constant 
and additional individualized Instruction is added* extended learning in 
advanced topics can be provided. The time for this extended learning takes 
away from extra practice in regular work* but test results show that the 
advanced work is learned without detriment to the usual grade level attain- 
ment. Also, with carefully programmed material* practice and review 
carried out at the beginning of a school year can be accomplished in a 
shorter period of time than usual* 

2* Generalized measures of intelligence are not necessarily related 
to student's tested achievement. The relationship of Intelligence to 
achievement depends on the Instructional method employed* With effective 
Individualized instructional procedures* aptitude and Intelligence meas- 
ures may be more related to rate of learning than measured achievement in 
a particular unit of learning* 

3* The variability of progress and the differential accomplishment 
of students indicate the urgency for the development of systems of instruc- 
tion which adapt to the individuality of the student. Students differ over 
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a very wide range with respect to the amount of time they require to attain 
mastery of a learning unit. Furthermore, when students are pretested on 
the contents of a lesson prior to instruction, a significant number of stu- 
dents show knowledge of what they are about to learn or the absence of 
adequate prerequisite knowledge and skills. 

4. Self— instructional activities using programmed materials ap- 
parently maintain student attentiveness. Observations of students during 

courses of programmed instruction indicate no increase in boredom or in- 
attention. 

Teachers and Supervisors 

5. The use of programmed materials makes difficult the usual pro- 
cedures that supervisors carry out to observe classroom instruction. The 
supervisor is accustomed to observing daily or weekly lesson plans and ob- 
serving the teacher working with the class as a group. With the use of 
self-study materials, much of the lesson plan is built into the programed 
materials, and teacher activity with an entire class of students is de- 
creased. If procedures for the individualization of instruction are im- 
plemented in a school, new thought must be given to the way in which su- 
pervisors evaluate teaching effectiveness. 

6. The usual structure of a school with its intact classroom makes 
the management of individualized Instruction very difficult for the teacher. 
When programmed self-instructional materials are used which permit the stu- 
dents to spread themselves out over a wide continuum of achievement, the 
teacher must develop techniques to control this range. If the school or- 
ganization does not change to meet the range of student achievement, it is 
necessary for teachers to employ techniques which minimize the extent of 

individualization so that they can perform their job as classroom teachers 
effectively. 

7. Most current pedagogical procedures taught in schools of edu- 
cation instill teachers with a need to hold the attention of the jtudent 
and to constantly mediate between the student and the subject matter. In 
contrast, self-instructional procedures preclude certain teacher activities 
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of this kind and give the teacher the feeling that he is really not teach- 
ing. As a consequence, teachers may frequently modify the use of self- 
instructional materials to permit "real teaching" to occur. The new role 
that the teacher must learn in individualised instruction is one which 
emphasizes more detailed evaluation of student performance. This requires 
more detailed prescription and guidance based on this evaluation than is 
the case in standard teaching. This role can be a highly professional and 

demanding part of the teacher's time and requires appropriate teacher 
preparation. 

Research Methodology and Evaluation 

8. When studies of individualized instruction are compared with 
the hard-to-define variable called "standard instruction," the results ob- 
tained in this report and in previous studies in the literature show a gen- 
eral pattern: self-instructional programs result in student achievement 

which is about the same or better than standard instruction; few spectacular 
differences have been shown here, and indeed in the history of recent inno- 
vation in classroom instruction. A number of hypotheses can be suggested 
to explain this; one hypothesis which has been suggested in the course of 
this work is the inadequacy of measuring Instruments for subject-matter 
achievement o 

To some extent it seems that test construction procedures are 
weighted against the display of the effects of different experimental in- 
structional treatments. In particular, published tests of subject-matter 
achievement are constructed to have specified levels of item difficulty. 
These levels of item difficulty permit the tests to differentiate among the 
students in order to provide a discriminating measuring instnnent; but 
artifacts are built into the test in order to provide levels of dif- 
ficulty? Suppose a child might have mastered the multiplication of three- 
place and four-place numbers; when an appropriate sample of items is em- 
ployed to test him, the student should get most of them right or most of 
them wrong if he has mastered the appropriate skill. It is conceivable 
• that procedures for building difficulty levels into tests oppose the 
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clear-cut measurement of subject-matter mastery and add an additional di- 
mension to the test. In order to provide differential difficulty, features 
are brought into the test which require incidental learning ou the part of 
the student. This incidental learning may be relevant or irrelevant to the 
subject-matter objectives at hand, but this incidental learning may not be 
irrelevant to general intelligence. It can be hypothesized that selecting 
item difficulty levels for a test in order to make it more discriminating 
makes it more a measure of IQ and thus lessens the relevance of the test 
to the effect of the instructional treatment which teaches a particular 
skill. Once multiplication of two-place numbers is taught effectively, what 
kind of difficulty levels are appropriate for measuring performance on this 
task: Should this measurement include the ability to transfer this learned 

skill to work problems and to new situations? If so, should this ability 
be taught or should it emerge as a function of general intelligence? A 
suspicion growing out of the sequence of studies in this report is the 
necessity for careful analysis of achievement measurement procedures which 
are relevant to the experimental comparisons being undertaken. 

9. End-of-course achievement examinations may be only one aspect, 
and a minor one, in the measurement of student achievement. ’’Learning" of 
the fundamentals of the subject-matter areas may be only superficially 
tested by end-of-course performance. The deeper effects of Instruction 
should show up in long-term measures of the recall of knowledge in appro- 
priate situations or in the ability to relearn a skill prior to its reuse. 

10. In general, the implications of the use of programmed instruc- 
tion in the classroom are the following: (a) Procedures need to be de- 

veloped to permit the effective management of individualized progress 
(b) Individualization procedures will include detailed diagnostic assess- 
ment of student capability of the basis of which instructional plans will 
be developed for him; (c) Research and development effort must be devoted 
to methodology * the evaluation of educational achievement; (d) Tests of 
student achievement should emphasize performance mastery and the subsequent 
use and reuse of knowledge and skills. Normative comparisons among students 
which do not specify the extent of mastery of subject-matter objectives may 
be of minimal use for the improvement of teaching procedures. 
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CHAPTER I 

THE USE OF PROGRAMMED MATERIALS IN 
ELEMENTARY ARITHMETIC AND SPELLING 

Robert Glaser, Janes H. Reynolds, Margaret G. Fulllck 

Introduction 

When the use of programed Instructional Materials is studied in a 
school system, two different approaches to implementation can be considered. 
One approach considers the concept of programed instruction as a mains for 
individualizing the instructional process. The other approach conceives of 
the program as a reproducible event that can be employed as a standard in- 
structional sequence around which certain variations in classroom procedure 
can be effected. 

The first notion, that of individualization, is a primary assump- 
tion behind the development of programmed instructional procedures. Ideal- 
ly, programmed instruction is a means whereby the student can be provided 
with instruction on the basis of his particular requirements. A tutorial 
process is the analogy of the individualization process. The efficient 
tutor determines in detail the knowledge and skill that the student has 
prior to instruction; he then begins instruction assuming only the compe- 
tences that the student has shown. The instructional procedure is adjusted 
for the student by the tutor according to the rate at which the student 
learns, the kinds of forward steps the student can take, and the kinds of 
experiences which the student finds rewarding and motivating for effective 
attainment of subject matter skills. 

Current use of programmed instruction has far from attained the 
ideal of the individualisation of instruction. At the present time,' how- 
ever, programmed materials and the concepts underlying them represent a 
step toward the provision of an individualized instructional environment 
for each student: they can permit the student to learn at his own rate 

and present him with the freedom to move ahead or catch up depending upon 
his mastery of the subject matter; they can also permit different students 



8 



to study different subject matters st the sene time In the seme classroom. 
When progress ere used with such Individualization In Rind # they obviously 
necessitate restructuring of the intact class room unit because different 
students In the class will require different instructional conditions „ Such 
reorganization Is considered desirable by many school administrators but 
Is a major problem for a school system where the unit of organization is 
Intact class groupings and yearly grade-by-grade advancement. 

Within the Intact classroom structure, experimentation with pro- 
grammed materials takes the form of treating the program as a standard in- 
structional technique which can be used In various ways in the classroom 
by manipulating certain aspects of the classroom instructional procedure. 

In this way, the achievement of the class and the manipulation of class- 
room teaching procedures become, respectively, the dependent and indepen- 
dent variables for study. 

For the most part, the introduction of programmed instructional 
niterlals in the Baldwin— Whitehall Schools took place In Intact classroom 
groups. The programs used were those commercially available at certain 
grade levels, and the variations studied were essentially manipulations of 
classroom procedure. The studies reported here took place in the academic 
year 1962-63 and with the exception of those in grade 9, represent attempts 
examine the use of programed Instructional materials within existing 
classroom structures. 

The Nature of the School System 

The studies reported here have been carried out in the Baldwin- 
Whitehall Public Schools, situated in a suburban residential area conti- 
guous to the City of Pittsburgh. The population of the area represents a 
cross-section of the metropolitan Pittsburgh area, ranging from skilled 
mill and industrial workers to executive and professional types. At the 
time of the studies the physical facilities of the school system consisted 
of one high school, two junior high schools, and 12 elementary schools 
(kindergarten through sixth grade). The total student enrollment during 
the 1962-63 term was approximately 8,000, with a classroom teaching staff 
of approximately 375. 
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The Qians t ions Asked 



The questions which were asked about the use of programs arose from 
primarily two sources: (1) variables studied in the psychologist's learn* 

ing laboratory that suggested a procedure for improving instructional ef- 
fectiveness, e.g., the distribution of practice, and (2) problems arising 
from general teaching practices and educational requirements, e.g. , the 
necessity for providing extended opportunities for learning (acceleration). 
Sometimes both of these sources provide the background for a particular ex- 
periment. 

Studies were designed to investigate the following kinds of ques- 
tions : 

.1* Can simple teaching machines be used in the classroom 
with young children beginning the first grade? What is the relative ef- 
fectiveness of different teacher-program arrangements upon learning? What 
is the relative effectiveness of varying the distribution of daily work 
with the program? What is the effect of prefamiliarization and post- 
learning practice in the achievement resulting from programed instruction? 
At the end of the school year, do classes using programs in arithmetic 
topics compare with classes not using such programs? 

Grade 4. What is the relationship between intelligence and use of 
programmed instruction under certain conditions? How effective is pro- 
grammed instruction for the review and acceleration of learning? What are 
the effects of classroom surroundings upon learning from a program? 

Grade 7. What is the effect of various combinations of programmed 
instruction and "enrichment" activity? Does prefamiliarization and an 
overview of material to be learned improve the effectiveness of programmed 
instruction? 

Grade 9. How effective is programmed instruction in providing the 
opportunity for learning additional subject material? 

Control Aspects 

When specific studies are set up in an on-going school situation to 
answer these questions, a number of variables must be considered which can 
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Influence the data obtained. The influeuce of these variables must be 

considered in interpreting the results of the studies or must be controlled 

in some way. The following aspects were of concern in the studies re- 
ported# 

of the Programm ed Instructional Materials . With the 
exception of one program constructed at the University of Pittsburgh, the 
programs employed were commercially available from reputable program pub- 
lishers. These publishers provided some evidence that the programs were 
constructed according to good program development practices and were ef- 
fective instructional instruments. This evidence was of Informal nature, 
since most program publishers at the present time do not provide manuals' 
giving detailed data on program use and validity. It is anticipated that 
manuals similar to those accompanying nationally standardized tests, con- 
taining the validation data obtained during the course of program develop- 
ment, will be made available in the future. Furthermore, standard cri- 
terion which publishers can follow in the development of a program manual 

are being developed by national committees (Joint Committee on Programmed 
Instruction and Teaching Machines, 1963). 

The degree of effectiveness of the various programs, especially 
for the population of students participating in the separate studies, was 
not specifically known prior to use, and the efficiency and effectiveness 
with which they taught varied. The extent to which the effectiveness of 
a program interacted with the particular study being carried out is dif- 
ficult to assess, and the differences in this variable of instructional 
quality ^as controlled only tc the extent that some impression was availa- 
ble about initial program constructioi and subsequent development and use. 

■ T . t? . e subject Matter . The subject matter taught by programs in the 
present studies was selected on the basis of (a) availability for the par- 
ticular grade levels involved and (b) subject matter requirements in terms 
of student need, school requirements, and student- teacher-community accep- 
tance as determined by the Baldwin-Whitehall school administrators. Of 
the eight commercial programs used, six pertained to arithmetic or mathe- 
matics. Ibis reflects the fact that a preponderance of programs available 
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at this time were on mathematics topics and that this is a topic readily 
Introduced Into school systems in program form; the two other subject 
matters were spelling and general science* The extent to which the greater 
number of programs in mathematics Influenced the results of the studies 
carried out is again difficult to assess* 

Teacher Character istics * In all of the studies , the teacher par— 
ticipated, to a greater or lesser degree, in Instruction in the subject 
matter area involved in the program* As a result, teacher characteristics 
could Influence the data obtained* However, since Intact classes were 
used, teacher characteristics were controlled to the extent that at least 
two different teachers were Involved in each of the experimental condi- 
tions compared* This limited control had the effect of preventing any one 
experimental condition from dependence upon a single teacher* In addition, 
teachers participating in the various studies were chosen on the basis 
of a positive (or at least a non-negative) Interest in trying out pro- 
grammed instructional materials* Prior to classroom introduction, teachers 
participated in the development of the particular procedures to be used; 
one teacher for each study at each grade level prepared a manual for all 
teachers Involved in that particular study* This manual consisted of a 
day-by-day plan of the specific classroom activities that would be carried 
out for the subject matter being studied. The exact manner in which the 
program was to be used was specified, and teacher materials for non-program 
Instruction were elaborated in detail* In this way, some standardization 
of the procedures being studied was accomplished* In addition, a research 
coordinator checked with the teachers several times each week in the course 
of a particular study to insure that procedures were being carried out as 
planned. 

Student Ability. Past experience in the Baldwln-Whltehall Schools 
has indicated that* differences among classes in intelligence levels and 
previous subject matter achievement influence learning from programmed 
Instruction* This is so despite the often-quoted claim that the individ- 
ualization offered by programmed instruction will reduce the relation- 
ship between student attainment and measured intelligence to near zero* 
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.There are a number of factors involved in assessing this statement which 
have been discussed elsewhere (Glaser, 1963). The fact is that with the 
programs used and the manner in which they were used in the studies re- 
ported here, such a relationship between aptitude and achievement does 
exist. As a result it has been necessary in the separate studies reported 
to control the classes compared on the basis of average intelligence and 
achievement levels, and comparisons to assess the effects of the indepen- 
dent variables have required careful matching of class means in order to 
draw appropriate conclusions. 

Testing Procedures . Crucial to the assessment of experimental ef- 
fects are the measures employed to test the dependent variable, student 
achievement. In assessing the outcome of programmed instruction various 
measures can be used, each of which has particular characteristics. Three 
main types of measures can be distinguished, namely, program tests, teacher- 
made tests, and nationally-standardized tests. Program tests are achieve- 
ment tests which accompany the program and which the program publisher 
considers an adequate sample of student performance of the objectives 
taught by the instructional sequence. Teacher-made tests are those tests 
developed in cooperation with the classroom teacher and consist of items 
representative of the educational objectives of classroom instruction. 
Nationally-standardized tests are those commercially available achieve- 
ment test 8 used by schools to assess their instruction and compare them- 
selves with national norms. All three types of tests were employed in 
the various experimental studies reported. Where the program test was 
not considered an adequate test of overall classroom objectives or of the 
program itself, it was supplemented by a teacher test or a nationally- 
standardized test. When a nationally— standardized test was used, agreement 
was obtained from the teacher and school administrators that this test 
was a satisfactory measure of their own course objectives. 

Ceiling Effects. If in assessing experimental variations in the 
classroom, a definitive test is established to indicate mastery of the 
course objectives, then the objectives of instruction are to teach so 
that students attain such mastery. This means that in successful instruction 




many students will obtain perfect scores and the distribution for a class 
will be skewed in accordance with a ceiling imposed by perfect test per- 
formance* If two different instructional treatments are given to two 
different groups and both groups show many students with near perfect test 
scores, there is then the question of distinguishing which treatment rep- 
resents the more effective instruction* Factors other than etudent achieve- 
ment, such as time taken to attain mastery, etc., must be considered. If 
achievement is the only measure of concern, however, then the percentage 
of students obtaining a perfect score, the average level of mastery or the 
gain in mastery from pre- to posttesting can be used. A question might 
always remain, however, with respect to how much more knowledge would have 
been exhibited by students if the test did not have a mastery ceiling. 

For example, if the objective of a course of instruction is to teach stu- 
dents addition and subtraction with single-digit numbers, a mastery test 
would measure just that skill, addition and subtraction with single-digit 
numbers* However, it is justifiable to ask to what extent students can 



The tests employed in the studies reported here are, for the most part, 
tests with mastery ceilings and were used to assess the attainment of 
specific mastery objectives* Sometimes tests of more general objectives 
were employed which did not display celling effects* These were usually 
nationally-standardized tests constructed so as to give a wide distribu- 
tion of scores* As will be seen in the studies reported, assessments of 
the various dependent variables are considered in the light of the 
characteristics of the achievement tests employed. 

Extrapolation of Laboratory Findings . As has been indicated, a 
number of the studies reported Involved variables suggested by laboratory 
experiments. In general, the direct extrapolation of a laboratory varia- 
ble to actual instructional practice in intact classes runs many risks* 

One is that in group experiments in the laboratory the differences between 
experimental and control groups are often obtained under stringently con- 
trolled laboratory conditions and It can be expected that an effect of 
small magnitude under such control conditions will be attenuated in the 
conditions of the practical classroom* For the most fruitful interaction 
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between the laboratory and instructional procedures in the classroom to 
take place, a research and development sequence is required which passes 
through fundamental laboratory research, through development, through de- 
sign and proving and field tryout (Gilbert, 1962; Glaser, 1964). 

The Processing of Data 

All data obtained on both pre- and posttests were punched on cards 
and appropriate statistics obtained on the University of Pittsburgh's IBM 
7070 computer. In working with intact classroom groups, individual cases 
are lost for a variety of reasons such as school transfer, absenteeism, 
etc* In addition, cases were eliminated in the attempt to match the classes 
compared, and the procedure whereby cases in the samples reported in this 
chapter were selected need to be specified here. For the experimental 
classes, no students were eliminated in any study because they obtained 
an exceptionally high or low score on an independent variable. Students 
were eliminated, however, if matching data on them were not available, 
i«e., IQ data and Stanford test achievement scores. Students were also 
eliminated if they missed more than one of the major subject matter post- 
tests. Students who were repeating the grade, of which there were rela- 
tively few, were not included in the study, and students who left the school 
district during the year were not included. On the basis of these criteria, 

approximately 4% of the students in a class were eliminated for any of the 
above reasons. 

Where data were missing on any one student, for example, only one 
posttest, the mean of the call for the variable Involved was used to fill 
in the missing data for computer analysis. This procedure was used for 
less than 1 % of the data obtained. 

In the control classes (receiving conventional instruction) no stu- 
dents in the first and fourth grade were eliminated; in the seventh and 
ninth grade study, students quite low in IQ, below 90, were eliminated for 
matching purposes. In the seventh grade, for matching purposes, students 
were eliminated if no Stanford Achievement scores were available at the be- 
ginning of the year; these scores were not available because some students 
entered the seventh grade from a six-year | _^chial school. 
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Arithmetic Topics in Grade 1 



Overview 



Three main studies were carried out at the first grade level, 
using programs to present arithmetic topics that constituted a significant 
portion of the first grade curriculum* These topics included learning the 
addition and subtraction facts and learning to tell time* In addition to 
these two topics, a program which taught students to recognise and write 
the numbers from 1 to 10 was used in an exploratory way* Selection of 
topics was based primarily on the availability of program appropriate for 
the first grade* Two of the programs were available commercial 11 7 , and the 
third (time-telling) was an unpublished experimental program uodeirgolng 
development at the University of Pittsburgh* 

Exploratory Study 

The exploratory study examined the feasibility of prec&ntlng pro- 
grammed instruction In a simple teaching machine on a group basis to aix- 
year-old children* The child entering first grade cannot read, is not yet 
adept at following complex directions, and may not yet have developed the 
motor and perceptual skills required for such tasks as using a pencil, turn- 
ing machine knobs, loading a machine with programmed materials, matching 
responses to feedback stimuli, etc* The objective of the exploratory study 
was to determine the effect upon learning when children in the first grade 
were given programmed instruction in a format requiring the use of a simple 
hand-operated machine* 

Teacher-Program Coordination 

The first more formal study (1A) 1 was designed to assess the rela- 
tive effectiveness of three methods of coordinating programmed instruction 



In this chapter, individual studies will be designated by a number 
indicating the grade level and a letter indicating the specific study* Thus 
(1A) is a designation for Study A (Teacher-Program Coordination) performed 
at the Grade 1 level* 
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with teacher instruction* A program, unlike workbooks or other tools avail 
able for the teacher's use, is constructed so that it will teach new mate- 
rial rather than simply supplement initial instruction given by the teacher 
This capability provides the teacher with a versatile tool which he can use 
either to Introduce new material for original learning or to provide re- 
learning, review, and practice of new material which he himself first in- 
troduces. Although such versatility permits a number of possible teacher- 
program combinations, there are no data presently available to indicate the 
relative effectiveness of various arrangements of teacher and program in- 
struction and review in an intact class situation* The purpose of this 
Investigation was to compare three teacher-program combinations in ten* 
of the amount of learning produced by each over a standard period of time. 

The subject matter taught in this study was single-digit addition and sub- 
traction* 

In the first combination, the teacher gave the original instruction 
in a small number o? new facts that were to be learned, and followed this 
initial Instruction with a program assignment which provided relearning, 
review, and practice with those facts* She then introduced more new mate- 
rial, and the cycle continued* In the second combination, a reversal of 
the first, the teacher assigned the program to do the initial teaching of: 
the new material, followed thia by additional teacher-directed review *d 
practice of that material, then assigned the program again to introduce 
more new material* A third comb lit ion employed was assignment of the en- 
tire program to provide the sole instruction in addition and subtraction 
over a period of several weeks followed by an equal time period in which 
the teacher conducted daily sessions of relearning and review of the mate- 
rial originally Introduced by the program* 

Distribution of Practice 

The purpose of the second investigation (IB) was to examine the 
effect upon learning from programmed materials of certain instructional 
variables which the teacher often manipulates in traditional classroom 



teaching. The subject matter in this study was time-telling. 2 One varia- 
ble Investigated was the spacing or distribution of learning sessions. 
Laboratory studies have indicated that, under certain conditions, learning 
is facilitated if practice is distributed over a period of time, with rest 
periods between practice sessions (McGeoch & Irion, 1952, Chapt. 5; Under- 
wood, 1961). In the laboratory investigations, the periods between prac- 
tice sessions have ordinarily been of rather short duration. In the present 
study, three different time periods of considerably longer duration than 
those ordinarily employed in the laboratory were used to separate learning 
sessions. One of the classes involved received two learning sessions a 
day with the time-telling program (morning and afternoon) , making the 
dally interpolated intervals approximately one-half of a school day in 
length and permitting the class to complete in seven days a program which 
ordinarily requires 14 days of single sessions. A second group received a 
8 ingle learning session each day for 14 school days, making the Interpolated 
interval between practices approximately 24 hours (with the exception of 
the two weekends that occurred in the course of the experiment). The third 
group was given a learning session every other day until the program was 
completed, making the Interval between sessions approximately 48 hours 
(again with the exception of weekends) , and the total time for program ad- 
ministration 28 days. A recent study (Reynolds and Glaser, 1963) employing 
spaced practice in a programmed instructional sequence has further suggested 
the possible facilitation of learning as a result of distribution of prac- 
tice. 

Pre-familiarisation . Another teaching variable studied in the 
time-telling experiment was pre-familiarisation with the material to be 
learned. There is evidence from verbal learning investigations that 



2 

Glaser, R., Reynolds, J. H. , and Weinstein, I. P. Time-Telling : 

A Teach er-Student Programmed Sequence . University of Pittsburgh, 1963. 

This program differs from the usual self-instructional sequence in that 
the teacher Is an active member of the instructional procedure The teacher 
and the class as a group work together at the beginning of each new unit 
and then students are permitted to work by themselves. The characteristics 
of this program are described in Glaser and Reynolds (1964). 
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familiarity with the atimuli »d reepon... that are to be aaaoci.ted facili- 
tates learning of the aaaociationa (Noble, 1961, p. 221). Research with 
laboratory learning taska other than verbal aaeoclatea has also suggested 
that preliminary exposure to material that 1. to be learned facilitates 
later learning by arousing the learner's curiosity (Berlyne, 1960). These 
laboratory flndlnga receive additional support from the well-established 
tendency of the classroom teacher to Initiate new topics of study by pre- 
senting an overview of what is to be learned, presumably motivating stu- 
dents to find out more about the new topic. leads all indi- 

cated that if the time-telling program were preceded by activity sessions 
in which the teacher familiarised the children with various kinds of clocks, 
the importance of being able to tell time, etc, learning from the program ’ 
wight be facilitated. In two of the six first-grade classes which took the 
time-telling program, a week of pre-familiarisation activity was given be- 
fore the program was introduced. 

P o 8t~leaniin g Practice . The final variable Investigated in Study IB 
waa the effect of post-learning practice upon retention of what was learned 
i* the program. All of the cl..... used in the study were given two teats- 
« teat immediately following the program to ...... learning, . retentlon 

test two weeks later. TVo cl...e, were given daily five-minute practice 
sessions in telling time, under teacher direction, during the two-week in- 
terval between testings. One of these classes had also received prefamil- 
iar isst ion, bm the other had not. The remaining classes received no 
formal post-learning practice in time-telling during the forgetting inter- 
val. It was expected that the us. of short but consistent practice periods 
would not only facilitate retention, but provide additional learning a. well 

for those learners whose performance on the first teat showed this to be 
necessary • 

Comparison with Non-nrog riawttad 

The third area of Investigation (1C) in the first grade was a gen- 
eral comparison of the arithmetic achievement of the experimental program- 
ming classes during the school year with classes receiving arithmetic 
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instruction by traditional methods only. 3 The experimental classes did not 
receive all of their arithmetic instruction throughout the year by program- 
ming methods. However, a substantial portion of the total time spent 
learning arithmetic did involve programming, or teacher efforts coordinated 
with programming, so it was of interest to determine the extent to which 

these lnstructlonsl procedures affected overall class achievement for the 
year. 

General Procedure 

Prior to the beginning of the school year, six first-grade classes 
were selected for participation in the programmed learning studies* Since 
little standardized test data were available regarding individual differ- 
ences before school began, an arbitrary choice was made of two classes 
from each of three elementary schools in the Baldwln-Whltehall school dis- 
trict. Neither the teachers nor any of the students in any of the classes 
selected had previous experience with programmed instruction* All of the 
teachers were experienced in teaching first grade, however, and were selec- 
ted in part because of their previous success and positive attitudes toward 
teaching. Mean IQ scores and standard deviations on the California Test 
of Mental Maturity (Primary), and the size of each of the Intact classes 
participating (after elimination of soma students in the course of data 
analysis because of sustained absence or school transfer) are presented 
in Table 1.1. This table describes the groups used in the analyses made 
for the exploratory study and for Studies 1A and 1C. Slightly different 
groups, to be discussed lster, were used In Study IB. 

Eech cless received the Introduction to numbers progrem presented 
through the Min-Hex II Teaching Machine at the beginning of the 
year, during the six-week period from September 10 through October 1?. 



3 

By traditional methods" is meant the usual teacher-classroom 
procedures being carried out by the particular school system at the time 
programmed instruction was introduced. The comparison made was between 
existing methods and a new technique. Thf term "existing methods" ob- 
viously is not rigorously defined. More definitive studies of the varia- 
bles involved in the instructional process are needed in order to indicate 
the measurable dimensions on which two such methods vary. 
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Table 1.1 

Group Size and Intelligence Means and Standard Deviations 
for the Six First-Grade Experimental Classes 



Class 




Intelligence 




N 


X 


s 


U 


21 


114.00 


15.05 


V 


23 


110.57 


13.42 


W 


17 


104*29 


10.13 


X 


17 


102.88 


12.74 


Y 


25 


113.32 


14 60 


Z 


18 


111.06 


14.44 


Total 


Group 


121 


X* 109. 84 X- 


•14.24 



The explicit method of presentation and the results obtained are described 
in detail below in the Exploratory Study. Following the introduction to 
numbers program, the classroom teachers presented a review of numbers, 
certain measurement concepts (such as pints, quarts, one half of a whole, 
etc.), and readiness activities for addition and subtraction until Decem- 
ber 10* On this date, all six classes began a ten-week period of coordi- 
nated teacher and programmed Instruction in addition and subtraction facts* 
During this time, the classes were given two 20-minute arithmetic periods 
each day, one in the morning and one in the afternoon. Programmed or 
teacher instruction was presented in these sessions according to varying 
experimental conditions that are described in detail below for Study 1A. 
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Between March 18 and May 1, the teachers gave further practice and 
review in addition and subtraction, and instructed the classes in other 
non-programmed arithmetic topics required at the first grade level, e.g. , 
a unit on money and counting by one's, five's, and ten's. In the last 
week of this period, two or the classes (randomly selected from the origi- 
nal six) were given additional activities which constituted pre-familiari- 
zation for the time-telling program. On May 1, all six classes began work- 
ing in the time-telling program and proceeded according to the methods de- 
scribed under Study IB below. Upon completion of this program, the teachers 
continued giving instruction in the usual Grade 1 curriculum topics for the 
remainder of the year. The schedule for the year is outlined in Table 1.2. 

Comprehensive achievement testing, the results of which are de- 
scribed in the next section, was conducted before and after the adminis- 
tration of each program. Also, a comprehensive test of arithmetic know- 
ledge was given at the end of the school year to all six experimental 
classes and to two traditional (control) classes. Comparisons between the 
experimental and control groups are presented in Study 1C below. 

To insure that these complex and extensive procedures were carried 
out according to plan, prior to the beginning of the school year a compre- 
hensive Teacher's Manual which served as a full-year's lesson plan was 
written by the elementary arithmetic supervisor in cooperation with the 
experimenters. This manual described the arithmetic procedures to be used 
on each school day, including such information as test dates, the activities 
and materials to be used on teacher instruction days, the specific kinds 
of readiness, pre-familiarization, and review procedures to be employed, 
etc. Throughout the year the experimental teachers followed these daily 
lesson plans, assisted and monitored by the elementary supervisor and the 
full-time research coordinator. Periodic meetings of the teachers, school 
supervisors, and experimenters were held to discuss progress, clarify 
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ambiguities in the instructions, and reorganise or elaborate the manual as 
necessary*^ By these procedures, adequate control was maintained over all 
experimental conditions throughout the year in terms of materials presented 
and manner and time of presentation* Of equal importance, the same degree 
of control was imposed upon the arithmetic activities interpolated between 
the specific experiments, providing some assurance that no group received 
distinct advantages or disadvantages from exposure to differing extra- 
experimental materials or methods* The obvious limitation in this control 
was the individual differences among teachers* Wherever possible, more 
than one teacher was involved in each of the experimental conditions in 
order to minimize the effects of these teacher differences* 

Exploratory Study: 

The Cli*8room Use of Simple Machines with Young Children 



Method 



In order to determine the utility of machines in presenting pro- 
grams to groups of young children, six classes were administered the intro- 
duction to numbers program* Prior to beginning work on the program, 
teachers conducted four daily sessions in number readiness activities, 
which consisted of flngerplays, counting songs, or simple number games; 
none of these Involved actual instruction in recognizing or writing num- 
bers* Next, five periods of practice with the machines were initiated in 
which teachers showed students how to manipulate the machine knobs, draw 
circles around correct responses to simple figure— matching frames, and 
confirm the responses made* Following this pre-training period, a pretest 
was administered to each student individually to assess his existing 



4 

A major reorganization of the experimental procedure did in fact 
occur as the result of one of these meetings* Originally, the plan was to 
administer the time-telling program in January, to be followed by the ad- 
dition and subtraction facts program* The teachers indicated, however, 
that the entering behaviors necessary for the time-telling program, such 
as counting by five's and writing numbers from one through sixty, would 
not be established by that time* Consequently, the manual was rewritten 
to specify daily operations for the plan outlined in Table 1.2. 
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Table 1*2 

Schedule for First Grade Arithmetic Instruction 



September 10-September 14 


Teacher instruction: number readiness 


September 15-September 21 


Practice with teaching machines 


September 24-October 19 


Introduction to numbers program 


October 22-November 23 


Teacher instruction: number review, 

measurement 


November 26-December 8 


Teacher instruction: addition and sub- 

traction readiness 


December 10-March 15 


Addition and subtraction program and 
teacher instruction 


March 18-Aprll 18 


Teacher instruction: review of ad- 

dition and subtraction, money, measure- 
ment 


April 21-Aprll 29 


Teacher instruction: counting by five's 

and/or pre-familiarization for time- 
telling program 


May 1-May 20 


Time-telling: a teacher-student pro- 

grammed sequence 


May 21- June 3 


Teacher instruction: arithmetic review 

or time-telling post-learning practice 



knowledge of numbers. The test was 40 items in length; Part I (10 items) 
measured the student's ability to write the numbers 1 through 10, Part II 
(10 items) measured the student's ability to count objects and then write 
the nuiaber. Part III (10 items) required the student to respond orally to 
printed numbers, and Part IV (10 items) required the student to copy 
printed numbers with a pencil. 
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On the day following the pretest, students began working with the 
program in daily 20-minute sessions. At the beginning of a session the 
student would take his machine from the shelf or table at the back of the 
room to his seat and wait for Instructions. (By pre-loading the machines 
and taping names on them, the teachers ensured that machines could be re- 
turned to storage at the end of each session and be ready for continued 
use by the same student during the next session. Thus problems in loading 
and finding places every session were avoided.) On each of the first three 
days, the teacher guided students frame by frame for just 20 frames, ex- 
plaining for each fram® what was required and the ateps the student must 
take to work successfully. From the fourth day on, students were permitted 
to work at their own paces, with the teacher circulating about the room 
to give encouragement and to help when machine problems developed. In this 
phase, however, no instructional aid concerning the context of the program 
was given. As each student finished, he was individually administered the 
numbers test again. Students who finished before the total time allotted 
for the experiment were assigned to practice and enrichment activities in 
number work after they completed the post test. In this manner, all stu- 
dents completed the program over the four-week period allotted, working 20 
minutes each day, and most had opportunity to engage in varying amounts of 
individual enrichment activities as well. The distribution of the number 
days (sessions) required by the children to complete the 615-frame program 
is shown in Figure 1.1. Figure 1.2 shows a scatter diagram of post test 
scores of time to complete the program and final score. There appears to 
be little correlation between the two measures. 

Results 

Achievement. Means, SB's, and mean percent correct for the pretest 
and posttest, as well as gain scores for all groups, are presented in Table 
1.3. The mean percentages on the pretest Indicate that five of .he six 
groups knew practically three-fourths or more of the material to be learned 
before being exposed to instruction. Even the grcupe with the lowest pre- 
test percentages, which were also the lowest IQ groups (see Table 1.1), 
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already knew over 50% of the programmed material. This finding is of in- 
terest, since the topic covered by the program was one which is usually 
Included in the first-grade arithmetic curriculum. The implication is 
that in an intact class many children may already know a significant amount 
about areas which are taught. More generally, the implication is that pre- 
testing of student achievement may be as significant a measurement proce- 
dure for effective instruction as is end— *>f— course examination. Frequency 
distributions, illustrated in Figure 1.3, show that 62% of the 121 stu- 
dents participating in the experiment reached the ceiling (or within three 
points of the celling) on the posttest. (This high achievement, plus the 
high protest achievement, necessarily limited the magnitude of the gain 
scores.) 

To obtain some estimate of whether this machine use of programmed 
instruction at this early grade level was generally effective in producing 
learning, pretest-to-posttest difference scores for each student in the 
six group 8 were calculated. Of the 121 students in the combined groups, 
only six failed to show gains, and two of these students had scores at 
the test celling on the pretest. Statistical tests are not necessary to 
conclude from these data that the general effect of the program was an 
Improvement in number performance, with the extent of observable improve- 
ment being restricted in 62% of the cases by the low ceiling on the mea- 
suring instrument used. The existence of a test celling, however, poses 
some dilemmas. A "test celling" can be considered a " level of mastery" 
which it is desired that students attain and which is the instructional 
objective of a program. A test can be constructed either to assess the 
attainment of this level or to assess attainment beyond this point. Ap- 
parently the test accompanying this program was of the former type. 

It was possible to further analyze the pre- and posttest means on 
certain subtests. Inspection of the data showed that high pretest scores 
predominated in Parts III and IV of the total test. By eliminating these 
two parts, the remaining subtests I and II together form a 20-item test in 
which celling effects were minimized and learning effects could be indicated. 



ERJC 



27 



Table 1.3 



* 

Means , SD*s, Percentages Correct, and Mean Gains for Six First 
Grade Groups on the Pre- and Posttests for the Introduction 

to Numbers Program 



Group 




Pretest 
(40 Items) 






Posttest 
(40 items) 




X 

Gain* 


X No. 
Correct 


X% X No. 

s Correct Correct 


8 


XX 

Correct 


U 


32.50 


4.04 


81 


37.57 


2.36 


94 


5.07 


V 


31.35 


8.14 


78 


37.00 


5.29 


93 


5.65 


W 


25.94 


10.94 


65 


30.62 


11.10 


77 


4.68 


X 


29.03 


6.54 


73 


33.74 


5.50 


85 


4.71 


Y 


31.44 


7.21 


78 


37.26 


3.05 


94 


5.82 


Z 


31.42 


4.49 


78 


37.14 


2.95 


93 


5.72 


*number of items 














Table 


1.4 given the 


means, SD's, 


and 


mean gains of 


the six groups on 


i Parts £ 


and 11 


combined and 


on Parts III 


and 


IV combined. 


Figure 1.4 shows 


the pre- 



and post-score distributions for Parts I and II and Figure 1.5 for Parts III 
and IV. The lower gains on Parts III and IV reflect the ceiling effect im- 
posed by the higher pretest scores. The gains for I and II combined, which 
are l®ss restricted by test celling, show that the six groups gained an 
average of four points, or about 20% of the 20-item measure, and that while 
on the pretest 12% of the 121 students showed at least 90% mastery, on the 
posttest 50% showed mastery at this level. 
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NUMBER OF STUDENTS 

Figure 1*4 Pretest end poet test distributions on intro- 
duction to numbers program, parts I and II 




NUMBER OF STUDENTS 



Figure 1.5 Pretest and posttest distributions on intro- 

to nimh * T * program, parts III and IV 
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Summary 



Results of the exploratory study in which a simple teaching machine 
was used to Introduce numbers to first-grade children indicated that these 
very young children could use and learn from Instructional programs pre- 
sented in machines* Thr particular machine used required the children to 
turn a knob and circle an object with a pencil* This was often a diffi- 
cult task and it would seem that at the first-grade level the development 
of machines which require less motor skill on the part of the student while 

at the same time using his already obtained-skills is a highly desirable 
direction for the future* 

This study with this particular program required both pre- and 
posttesting of the subject matter to be learned. Pretesting indicated 
the attainment of mastery on the part of a sizeable number of students, 
indicating that the use of the program for many of the students was redun- 
dant* While at the beginning of the program 59 out of 121 students indi- 
cated near mastery of the subject, after the program 102 out of 121 indi- 
cated such near mastery* However, the evidence provided by the pretesting 
indicates that individualized Instruction based on the pretesting of at- 
tained competences prior to learning is a significant aspect of efficient 
instruction* 

Effect of Intelligence. The relatively lower gain that is shown 
in Table 1*3 for Group W, which was the lowest of the six groups in mean 
Intelligence, suggests that amount of gain on Parts I and II was related 
to intelligence* However, the correlation for the total group between in- 
telligence and gain on I and II combined was r»*13, which is not signlfl- 
cantly greater than a zero correlation for N«121. Further inspection of 
the relationship between intelligence and performance on Parts I and II 
combined showed that IQ, as measured for these young students, was a rela- 
tively poor predictor of either pretest performance (r«*34), or ^osttest 
score (f.28). Intelligence, as measured, apparently had only a slight 
relationship to the task of learning numbers, and had no relationship at 
all to the gain accruing from programmed Instruction in this task* 
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Teacher React long. The general feeling of the participating 
teachers , as judged from informal conversations, was that the program had 
provided an adequate basis for further work in arithmetic. There was, how- 
ever, some question about the relative efficiency of teaching the parti- 
cular topic by program as compared with the traditional manner of teaching 
numbers, a question which was not investigated in thie. experiment. The 
most important and general criticism was that, although the students ob- 
viously learned, they were not adept at using the machines independently. 
Their undeveloped motor skills at this early age level resulted in inac- 
curate recording of responses, and frequent jamming of the machines. Ini- 
tially it was necessary for the teachers, themselves inexperienced in ma- 
chine usuage in the classroom, to spend considerable time adjusting me chl ne s 
because the children weae Incapable of doing this independently. The prob- 
lem diminished somewhat as the experiment progressed, but most of the 
teachers considered that the time consumed in this mechanical activity 
would have hindered their effectiveness had they been asked to give indi- 
vidual instructional help during the program sessions. The implication was 
that efficiency in programmed instruction at lower grade levels might be 
improved by presenting materials through machines which require less motor 
skill on the part of the student (e.g., automatic filmstrip displays, pres- 
sing buttons for responding, etc.) than those used in the present experi- 
ment. 5 



5 

It should be noted that the reported machine problems were probab- 
ly not due to the machine itself. Older children, being less careless and 
more coordinated than first graders, have used the same machines over long 
periods of time without jamming and attendant problems noted here. Even 
the first graders had fewer problems once they became accustomed to the 
machine. 
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Study 1A: 

The Effect of Varying Teacher-Program Combinations Upon Learning 



Method 



In order to employ and compare three different modes of teacher- 
program coordination, each two of the six original arithmetic classes were 
assigned to one of three conditions* The three condititions differed in 
the mode of instruction used to present new material and review material 
in addition and subtraction. Classes U and V, both located in the same 
school, constituted Group T-P; they received Initial Instruction in an 
addition and subtraction topic from the teacher (T) , followed by practice 
and review in the same topic from the program (P) , before advancing to a 
new topic* Classes W and X, in another school, formed Group P-T* This 
group received initial instruction in each new topic from the program, fol- 
lowed by practice and review under teacher direction before going on to 
new material* Finally, Group P-P, composed of classes Y and 2 in a third 
school, received only the program during the first half of the experiment, 
working daily in the program until it was completed; after this the teachers 
in Group P-P reviewed all of the addition and subtraction facts daily for 
the remainder of the experiment* 

Each condition received two 20-minute periods of arithmetic instruc- 
tion per day, a period in the morning and a period in the afternoon, in 
order to facilitate the coordination between teacher and program for the 
T-P and P-T groups* For short topics, instruction could be given in the 
morning session, followed by review and practice in the afternoon. With 
topics requiring more than one session of initial instruction, consecutive 
program sessions were used, followed by a number of teacher sessions for 
practice and review for the P-T group, or consecutive teacher instruction 
sessions followed by a number of program sessions for the T-P group. (It 
was often necessary to allow more sessions for initial teacher instruction 
in the T-P group than were required for initial programmed instruction in 
the same topic for the P-T group.) 
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One week before the experiment began, teachers In the three groups 
conducted certain readiness activities considered to be prerequisite to 
starting the addition and subtraction facts program* The activities , 
taught only by the teacher , Included review of number meaning and relative 
number value, counting practice, and learning to use new terms and signs 
(e*g*, plus and minus, take away, etc*)* Following this orientation week, 
a 90-item pretest was given containing 45 addition and 45 subtraction 
facts* For ten weeks thereafter, the three groups received coordinated 
teacher and program instruction in addition and subtraction, according to 
the experimental conditions just described* 

Of the 25 units in the program, only the first 10 were teaching 
units, the last 15 being review and practice * The groups were paced 
through the program (i.e., told by the teacher exactly how many frames 
were to be completed during a given work period) on the teaching units* 

On the practice units 11-25, students were permitted to work at their own 
paces during the 20-minute sessions allotted to programming, but still 
worked as a group with the teacher in the teacher sessions* This indivi- 
dualized pace in the last 15 units of the program resulted, of course, in 
students finishing the program at varying times according to differences 
in individual speed and learning progress* As each student finished, he 
was given the 90-item posttest, which required an administration time of 
approximately 30 minutes, and then was given individual arithmetic assign- 
ments to complete daily until the other students had completed the program* 
The posttest was the same as the pretest and consisted of single-digit, 
two-row addition and subtraction problems* 

Since the P-P Group received the entire program before being given 
any teacher-directed review, the testing procedure for this group varied 
slightly from that for the others. As students in the P-P group finished 
the program they were given a first posttest to assess what had been 
learned from the program alone* The second post test was given following 
the subsequent teacher-directed review of addition and subtraction, which 
measured the achievement effect of the program-plus-teacher treatment* 
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The time and order of testing and instruction were specified for 
each group in the Teacher's Manual. Directions for administering all 
teacher-directed sessions, Including topics to be covered and specific 
materials to be used in presenting either new or review topics, were also 
specified on a day-by-day basis. In this manner, the amount and type of 
material presented by the teacher was controlled over all groups. 

Results 



Achievement . One aspect of the experimental design did not proceed 
according to plan and should be taken into account in interpreting the 
achievement data. Three weeks after the beginning of the experiment the 
two teachers in the T-P group requested that they be permitted to give 
only teacher instruction to their classes for one week, rather than supple- 
menting initial learning with the program review assignments as originally 
planned. This request was granted, and therefore data for this group is 
not wholly the result of the T-P procedure described above; rather, the 
data includes one week out of the ten in which teacher instruction was used 
without any additional program review. Reasons for this request and change 
will be described later. 

Intelligence data and the various pre- and posttest scores for all 
groups are presented in Table 1.5. Figures 1.6, 1.7, and 1.8 show the pre- 
and posttest distributions for the three experimental groups. Since the 
P-T group was lower than the others in intelligence, and all three groups 
differed in pretest performance, statistical analyses of achievement were 
made for gain scores rather than posttest performance. On the total test, 
mean achievement gains for the T-P, P-T, ard P-P groups were 44.51, 41.09, 
and 46.02, respectively. Comparisons between groups on these mean gains 
for the total test yielded t, values ranging from .29 to .98 (p>.10), in- 
dicating that all group differences in gain were within chance limits. 
Comparisons of gains on the addition and subtraction subtests separately 
yielded similar results, with none of the differences among the groups 
large enough to reach statistical significance. Consistently, the varying 
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experimental treatments failed to produce variations in amount of achieve- 
ment gain. However, the fact that the T-P group achieved nearly the test 
celling (the mean percent correct for group T— P on the total posttest was 
97%) indicates that many students *n this condition actually mastered the 
subject matter while those in other groups did not. Whether mastery can 
be attributed to the experimental T-P treatment itself or simply to the 
higher pretest mean for the T-P group cannot be answered from the present 
data because the test was designed to measure the specific mastery to be 
attained, and the test had this level as a celling. Had the test included 
items requiring the student to use his knowledge for more difficult prob- 
lems, it is possible that the T-P group would have demonstrated greater 
gains than P-T or P-P, which would indicate a superiority of the T-P 
treatment • 

Mean scores and distributions on the interim posttest, taken by the 
P-P group immediately following programmed instruction and before beginning 
teacher instruction, are also shown in Table 1.5 and Figure 1.8. Exami- 
nation of the addition and subtraction interim and posttest scores shows 
that the program alone was more effective in teaching addition than sub- 
traction. For the total test., however, it can be seen that achievement 
gain made by group P-P following programming alone was approximately half 
as large as the gain following combined programming and teacher presenta- 
tion in groups T-P and P-T. From these data it appears that the two in- 
structional modes contributed about equally to the total achievement gain. 
To substantiate such an impression, however, it would be necessary to eval- 
uate gains from teacher instruction alone during the first half of the 
total experimental period. Possible effects of the teacher alone 9 or the 
program following teacher introduction, cannot be determined from the 
present experiment. But it is clear from the interim posttest performance 
of the P-P group that exposure of first-graders to this particular program, 
without intervention by the teacher, did not produce the amount of achieve- 
ment possible when teacher and program were coordinated over a longer 
period of time. 
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PRETEST POSHEST 




NUMBER OF STUDENTS 

Figure 1.6 Pretest and posttest distributions for addition 
and subtraction. Group T-P (N*44). 



PRETEST POSHEST 




NUMBER OF STUDENTS 

Figure 1*7 Pretest and posttest dlstlrbutions for addition 
and subtraction. Group P-T (N*34) . 



PRETEST POSHEST INTERIM 




Figure 1.8 Pretest and posttest distributions for addition 
and subtraction. Group P-P (N»43). 
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Additio nal Comment . a general concern of the teachers was that the 
organization of this program was very different from that which was used 
when teaching this topic by traditional methods (for example, teachers felt 
that the program was not organized around "number families," the number 
line was presented at the wrong time, etc.). This "problem” precipitated 
a tempory deviation from the original design for the T-P group because the 
T-P teachers felt that they needed to spend a week r@-teaching the material 
in a way that comformed more closely with methods they had used in the past. 
Following this brief period students continued with the original design, 
and no further problems were encountered that necessitated changing the de- 
sign again. It is interesting that discrepancies between tne program struc- 
ture and the subject matter organization customarily used by the teachers 
in traditional instruction did cause some difficulty, since it demonstrates 
quite clearly the desirability of having programs evaluated for content 
and structure by the teachers planning to use them before they are put in 
use. It also emphasizes the fact that programming research and development 
my result in new ways of presenting the subject matter and that teachers 
may need to empirically determine for themselves, by classroom tryout or 
by the evaluation of field test data, the effectiveness of these new 
methods « 

Summary 

Interpretations about the use of a program must be made in the 
light of the characteristics of that particular program. The addition and 
subtraction program employed in this experiment, when used by itself for 
the P-P group, taught only to partial test mastery. This is indicated in 
Table 1.5 and Figure 1.8. With this particular program, teacher instruc- 
tion Increased the specified mastery level on the program test. In the 
context of this situation, the different arrangements of teacher-program 
coordination had no differential effect on student attainment. While the 
different groups achieved different levels, this appears to be primarily a 
function of the entering level of arithmetic achievement; average gains in 
achievement, however, were the same for the different experimental groups. 
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It is to be pointed out that the experimental variations made here 
were group (intact class) manipulations which worked with the class (all 
students) as the Instructional unit rather than the individual student as 
the instructional unit* When the class is conceived as the Instructional 
entity, instructional variations aimed at total class manipulations appear 
to have little effect. What seems to be necessary are variations in instruc- 
tion aimed at the individualization of instructional procedures. 



Study IB: 

Effects of Frefamiliarlzation, Distribution of Instruction, 
and Post-learning Practice Upon Programmed Instruction in Telling Time 



Method 



Design and Procedure . In the time interval between Studies 1A and 
IB, the six first-grade teachers instructed the experimental classes in 
(a) counting and writing by one's from 0 to 60 , and (b) counting and 
writing by five's fro® 0 to 60. Formal instruction in these skills en- 
sured that nearly all students participating in Study IB would learn the 
prerequisite behaviors necessary for working through through the time- 
telling program. Following this, each of the classes received the time- 
telling program under one of the six experimental treatments which differed 
in types of prefamiliarization, distribution of practice, or post-learning 
practice. The design is summarized in Table 1.6, which shows for each 
class the treatment received and the symbols which will be used to desig- 
nate them. The design permits comparison of groups receiving the three 
levels of distributed practice (DP), i.e., programmed learning periods once 

f- ^ 

a day (DPI) , twice a day (DP2) , or every other day (DPO) ; and also groups 
receiving various combinations of either prefamiliarization (PreF) or post- 
learning practice (PostL) with DP held constant at one programmed learning 
session per day. 

The total program involved both paced group participation and in- 
dividual wo- k and required 14 instruction periods * Consequently , e*roitp DP2 
completed the program in just seven school day© while W® reats&red 
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28 days to finish by working every other day. For one week prior to be- 
ginning the program, the PreF and PreF-PostL groups received a period each 
day in which the teacher presented various activities designed to acquaint 
them with clocks and arouse interest in telling time, e.g., making a scrap- 
book of clock pictures, drawing a clock face, and reading a story about 
clocks. The remaining groups proceeded with their usual class activities 
during this week. Following the program, the PostL and PreF-PostL groups 
received practice in reading a clock for ten minuter each day for two weeks, 
while other groups continued their usual work without further time-telling 
practice. The practice periods, which occurred during the time between a 
posttest and a retention test on the material taught in the program, con- 
sisted of the teacher showing the claws vaiious time settings on a large 
clock held up in the front of the roor and asking the student to either 
write or say aloud the times indicates. After each setting, the teacher 
told the students the correct answer and wrote it on the blackboard. No 

additional instruction in how to read a clock was given during the post- 
learning periods, however. 

Testing. All groups received a pretest the day before beginning 
the program, a posttest on the day following completion of the program, 
and a retention test two weeks after the posttest was administered. 

(Groups PostL and PreF-PostL received post-learning practice during this 
two-week interval.) The pretest, group administered by the teacher, re- 
quired the student to write the numbers from 0 to 60 by five’s, to write 
certain numbers between 0 and 60 as they were dictated by the teacher, and 
to write the times indicated by 12 small clocks (1 1/2“ diameter) mimeo- 
graphed on the test sheet and eight settings of a large Western-Union 
clock (11 1/2" diameter) displayed in front of the classroom. These tasks 
provided measures of each jtudent’s skill in the prerequisite behaviors 
necessary for taking the program, and also indicated the degree to which 
students already knew the material to be learned. 
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At both the posttesting and the retention testing, which were iden- 
m wmtm&E and procedure, students were presented with a series of 



settings * to which they responded by either writing or saying aloud 
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the time indicated by each setting. The first series consisted of eight 
printed clocks identical to the six-inch clock faces used in the program. 
This test, called the Program Clocks Test, contained the following settings: 
2:47, 6:30, 11:24, 10:10, 3:21, 9:19, 12:30, 8:40. The second series were 
twelve smaller clock faces, the same as those used in the pretest, which 
were printed on a single test sheet. The settings (only to the five-minute 
mark) appearing in this Small Clocks Test were: 8:00, 11:05, 8:15, 7:45, 

2:30, 11:50, 4:20, 6:15, 3:35, 10:55, 12:10, 5:40. For the third test, 
eight settings of the real Western-Union clock were shown to students by 
the experimenter who set the clock to each setting in turn and then held 
it up so the student could observe it and respond. The settings of the 
Real Clocks Test were: 1:05, 6:40, 4:00, 10:19, 3:52, 9:30, 12:47, and 

8:04, These tests provided two measures of what was learned from the clock 
stimuli used in the program: a written measure, consisting of the total 

number of correct written responses the student made to all 28 clocks in 
the three tests combined, and an oral measure, which was the total number 
uf correct oral responses the student made to the 28 clocks. 

Both the posttest end the retention test required three adminis- 
trators and approximately three hours time per group. Written tests were 
given first, on a group-testing basis, followed by individual testing of 
each student for oral responding® In the written test, the group was given 
the Program Clocks Test (in a stapled booklet) and instructed to "write 
what each clock says in the box underneath the clock." Then the Small 
Clocks Test was administered, with the same instructions. Finally, the 
tester displayed the various settings in the Real Clocks Test from the 
front of the room, and students wrote their answers in specially constructed 
booklets. Following this written phase, each student in turn was called 
from the room and asked to respond orally to the same three tests. In 
this phase, the first experimenter presented the Program Clock settings 
to the individual student and asked him to "tell me what these clocks 
say. The second experimenter presented the Small Clock settings in the 
same manner, and a third experimenter administered the Real Clocks Test. 

Each experimenter recorded verbatim all oral responses which occurred. 
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Remits 



Performances on the dock-reading sections of the pretest Indicated 
that none of the 121 students co^sld tell time prior to administration of 
the program. Seven students were eliminated because their pretest scores 
on the counting and number-writing sections were below 70X, Indicating 
that tkBy lacked the prerequisite behaviors necessary for taking the pro- 
gram. Thirty-two other students from the various groups were absent freo 
school at critical times during the experiment, missing one or more of the 
tests administered, and had to be eliminated from the final analyses. 

These eliminations, the result of a run of colds and measles, caused dras- 
tic reductions in the size of the groups available for final comparison. 

Pretests . Table 1.7 presents the N's of the groups eligible for 
final analysis, and the means and SD's of each group on the four sections 
of the pretest. Since the total possible scores on the numbers and count- 
ing sections were 12 and 10, respectively. It is apparel that students In 
all groups had the prerequisites for taking the program. The consistently 
low weano on the clock reeding sections indicates that no group was abl< e 
to read a clock and write down the time prior to taking the program. 

Table 1.7 also presents the IQ means and SD's for the groups, which vary 
from those reported in previous experiments because of the elimination of 
many students. 

Posttests. The six subtests administered immediately following the 
program were combined to yield two scores— a written posttest score con- 
sisting of the total correct written responses on the Program, Small, and 
Reel Clock Tests, and an oral posttest score, consisting of the total num- 
ber of correct oral responses on these three tests. The data for eech 
group on the written and oral posttests are presented in Table l.d. These 
data were used in testing two experimental hypotheses: (1) that pre- 



a programmed sequence is related to the manner In which practice sessions 
ere distributed over time. 



atiem facilitates learning, and (2) that the amount learned from 
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Table 1.8 

Means and SD's for All Time-Telling Groups on Written 
and Oral Posttests and Retention Tests 









Posttest 






Retention Teat 








Written 
28 items 


Oral 
28 items 


Written 
28 items 


Oral 
28 items 




N 


X 


8 


X 


8 


X 


8 


X 


8 


DPI 


18 


19.00 


8.58 


18.22 


7.75 


19.17 


8.11 


19.17 


7.91 


DP2 


17 


18.76 


7.62 


11.47 


7.43 


17.29 


7.36 


17.71 


9.25 


DPO 


8 


11.13 


8.97 


10.51 


9.50 


15.01 


10.62 


13.62 


9.62 


PreF 


10 


10.10 


6.06 


6.80 


7.30 


10.70 


7.47 


8.10 


7.73 


PostL 


20 


19.05 


7.45 


12 • 60 


6.56 


18.85 


7.90 


17.4? 


7.62 


PreF-PostL 


9 


15.22 


7.39 


10.78 


6.87 


17.89 


4.77 


15.67 


6.18 




F ml^lllarlaatlon effects . The appropriate analyses for de- 
termining the effect of prefamiliarization are comparisons of Group PreF 
and Group DPI* each of wliich had the same learning treatment (program once 
varying familiarization treatments. Inspection of the means 
groups on the written and oral post tests indicates that* contrary 
to the hypothesis* Group PreF performance was consistently lower than that 
of Group DPI. The difference in means between these groups is significant 
on each posttest measure (t-2.80, df/26, p<.01* and t»3.66* df/26, p<.01, 
respectively) . 

However* analysis of mean IQ scores for the two groups indicates 
that the mean IQ for Group DPI was significantly higher than that of 
Group PreF (t*2.50* df/26* p«*01). This would saem to indicate chat the 
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lover posttest scores for the group that received prefamiliarization might 
be not entirely due to differences in treatment but possibly to differing 
IQ levels, although in subsequent studies in this report IQ was found to 
be a poor predictor of post-program achievement scores. 

A second analysis testing the effect ©£ p^fasdliaKio-'Mita® is the 
comparison of Group DPI with Grt-ujy ©i&ee cte Jitter group had 

received the prefamlllarlzation treatment and th© program one© -s day but 
at the time of the immediate posttest© ted not yet had any posfcle&misag 
practice. An analysis of mean IQ indicated no significant differ- 

ence between the two group© ((t«* 1 . 17 , df/ 25 , p ^ * 05 ) . Mthee$;h itese fee 
groups did not differ reliably on the written posttest (felJJb,, df/25. 



p>.05), the direction of the difference was again contrary to prediction.. 

On the oral posttest, the difference contrary to the predicted direction 
was found to be significant (t»2.35, df/25, p^feOS). ftese results are 
generally consistent with the DPI vs. PreF comparisons above, but because 
of the difference between the groups in the first comparison it is dif- 
ficult to state explicitly that prefamiliarization had an adverse effect 
upon posttest performance. 

2. Distribution of practice effects . An analysis of variance per- 
formed on the IQ data for the DPI, DP2, and DPO groups indicated that group 
differences in intelligence were not significantly greeter than chance 



(F»2.12, df/2, 40, p^.05). Further variance analyse© ©if these groups 
were performed for the written and oral posttest data to determine If the 
varying distribution of practice treatments produced different.©© in & fas- 
tening performance at the end of the program.. Although cte mm* differ- 
ences among the groups appear to be quite large in Table I .,10 tte iiife are 
large also; consequently, the F*s obtained for the it/© post test© c/ace 2.65? 
and 3.73, respectively., neither of which is significant at tte *c»$ level 
with df«2, 40. Apparently the distribution treatments of two sessions per 
day, one session per day, and a session ew&ty other day had no reliable 
effect upon posttest performance. 
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Retention Tests * Table 1.10 also summarizes the written and oral 
data obtained on the retention tests, which were given two weeks following 
the administration of the posttests. The hypotheses tested with these re- 
sults were: (1) that prefamiliarization facilitates retention, (2) that 

post-learning practice facilitates retention, and (3) that retention is 
affected by differences in the distribution of practice sessions during 
learning. 

1« Prefamiliarization effects . Inspection of Table 1.10 shows 
that Group PreF again performed at a consistently lower level than Group 
DPI, contradicting the original hypothesis. The differences between the 
trio groups are significant on both the written retention measure (t~2.62, 
df/26, p <.02) and the oral measure (t*3.45, df/26, p^.OOl). A second 
comparison between Group PostL and Group PreF— PostL, was made to determine 
if the prefamiliarization t aatment had any effect when combined with post- 
learning practice. An analysis of mean IQ scores showed the differences 
between the groups to be not significant (t-.79, df/27, p>.05). As can 
be seen in Table 1.10 the mean differences are again in the opposite di- 
rection from the one predicted. The ^roup receiving prefamiliarization 
had lower means on both the written and oral retention tests, although the 
difference between these groups was not large enough to be considered re- 
liable (ts»33 and .58, respectively, df/27, p^.05). However, an analysis 
of gain scores over the retention period indicates no significance in gain 
oral responding (t».35, df/27, p>.05), but a highly significant gain in 
written responding (t-7.89, df/2/, p<.005), indicating that prefamiliari- 
zation may have some facilitating effect upon retention. 

2. Post-learning practice . The evaluation of effects of post- 
learnlng practice was made by comparing Group DPI with Group PostL, since 
both had received the same learning conditions (program once per day) but 
only the latter had received t her-directed practice in telling time 
during the two weeks which elapsed between the posttests and the retention 
tests. The t tests performed showed no significant differences between 
those groups on either the written (t*.15, df/36, p^.05) or the oral 

(t*.68, df/36, p]>.05) retention measures. However* an analysis of gain 
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scores shows that Group Post! demonstrated a significantly higher gain in 
achievement over the retention period (t-2.22, df/36, p<.05) on the oral 
retention measure® although the gain during the retention period on written 
responding was nonsignificant (t— .21, df/36, p>.05). It is probable 
that the gain in oral responding was to some extent related to extra-class 
practice in time-telling. This would seem to Indicate that gain over the 
retention period was little facilitated by post-learning practice. 

It should be noted again that the post-learning practice did not 
include further instruction in time- tel ling, but simply a regular daily 
exposure to the taks already learned in the program. Nevertheless, the 
finding that such exposure had little effect upon subsequent performance 
was unexpected. The implication is that, witlm young children, practi e 
with materials that are not already completely learned may not necessarily 
constitute opportunity for further learning through discovery or example. 
Instead, it appeals that specific and well-analyzed instruction is the best 
procedure to insure learning to mastery. On the other hand, the data sug- 
gest that what has been learned at a concentrated rate may be retained at 
full strength by young children for a period of at least two weeks with- 
out any formal practice. Further research concerning the retention of 
first graders would seem to be most interesting and fruitful. 

3 * Distribution of practice effects . The F values obtained from 
analyses of variance performed with groups DPI, DP2, and DPO on the written 
and oral retention measures were .66 and 1.03, respectively, indicating 
that differences among the groups were well within .05 limits of chance 
on both tests. The various distribution of practice schedules used during 
programmed instruction had no significant effects upon retention of either 
written or oral response learning. These results coincide with the non- 
significant findings obtained for the distribution of practice variable 
on the posttests. Apparently variations in instruction schedules, with 
this type of material at least, can be made quite freely in a classroom 
situation without affecting student achievement. 
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General Comment 

Although the program did not teach all students to mastery, many 
were capable of reading a clock to the minute interval by the end of in- 
struction* Skill at this level of precision was impressive to the teachers, 
because most attempts at teaching time-telling to first graders go no 
further than instruction for reading five-minute intervals, and relatively 
few children, at this grade level, learn to read a clock with even that 
much accuracy. Figures 1.9 and 1.10 show bar charts of the number of stu- 
dents reaching mastery or non-mastery in the two higher intelligence 
classes (DPI and PostL) and the two lower Intelligence classes (DPO and 
PreF) , respectively, on both the posttests and retention tests. The graphs 
indicate that the students in the two higher IQ classes generally achieved 
higher scores on the various final tests. The lower intelligence classes 
had a consistently smaller percentage of success, suggesting that IQ is 
probably related in some degree to mastery of this particular program. Al- 
though the performance is by no means perfect, the teachers felt that the 
program nad taught many students and had provided considerable learning for 
many others, probably making further instruction to complete mastery far 

less difficult and time consuming than if the program had not been adminis- 
tered. 

Summary 



The time-telling program was built as an experimental programmed 
sequence to study certain aspects of learning in young children. It was 
used in this study as a means of teaching, rather intensively, a skill 
which is usually taught incidentally in the course of the first and second 
grades in connection with arithmetic topics. In contrast to addition and 
subtraction, time-telling represents a topic which teachers generally find 
difficult to teach and children find difficult to acquire, and therefore 
the teachers readily welcomed programmed instruction. The addition and 
subtraction program was less well received because teachers generally are 
quite successful in teaching addition and subtraction facts. The time- 
telling program taught many children to mastery but questions remain about 



Figure 1*9 Pretest, post test, and retention performance of students (N*39) in the two 
higher I.Q. first grades (average intelligence 112 • 36) • The percent of 

student 8 Attaining 752 or more of complete mastery is recorded above e ac h 
graph. 
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Figure 1.10 Pretest, postcest, end retention performance of students (N«18) in the two 

lower I.Q. first grades (average intelligence 101.75). The percent of 

students attaining 75% or more of complete mastery is recorded above each 
graph. 
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why this program waa more successful for some children than others, and 
whether such a topic 1® best taught Intensively as it was here or more in- 
cidentally as it usually is in the course of learning arithmetic in the 
first and second grades. 

Pref amiliarlzation , a technique frequently used by teachers in 
various topics, in this particular case had either no facilitating effect 
or an adverse effect on learning and retention. 

Different distributions of instruction had little differential ef- 
fect upon performance, suggesting that certain variations in dally schedules 
may have no strong effects on student achievement. 

The post-learning practice results suggest that practice in the 
form of class recitation for material that is not already learned may not 
constitute a further learning opportunity. 

The retention data suggests that the intensive rate of learning 
provided in a programmed sequence is not detrimental to retention. Along 
these lines, laboratory studies of learning in general indicate that best 
retention is obtained for materials which are best learned. 

The distribution of time-telling test scores for the above-average 
and average intelligence groups appears to suggest that the time-telling 
program is Influenced by student intelligence. However, this conclusion 
warrants further investigation since the intelligence distributions of the 
two groups are not widely divergent. Previous work with the time-telling 
program suggests that more important than measured Intelligence is the pres- 
ence or absence of specific prerequisite behavior needed to begin the pro- 
gram. 



Table 1.9 

Means and Standard Deviations for Experimental and Control 
Groups on the Addition and Subtraction Teat 



Group 


Total A and S Teat 
N (90 items) 


Addition 
(45 items) 


Subtraction 
(45 items) 




X 


a 


X 


a 


X 8 


Program 


121 82.02 


13.99 


42.08 


5.03 


40.33 


8.71 


Control 


38 82.71 


11.42 


42.37 


4.57 


40.34 


7.22 







Table 1.10 




Means and Standard Deviations for Experimental and Control Groups 
on the Written and Oral Time-Telling Tests 


Group ■* 


N 


Written (28 items) 

X a 


Oral (28 items) 

X a 


Exper: toental 


121 


16.13 8.47 


14.72 8.59 


Control 


38 


S.S0 5.15 


6.16 5.19 




Written 


t-7.28, df/157, p<.001 


*** 




Oral 


t-5.78, df/157, p<.00l 
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Study 1C: 

Comparisons of Program and Non-Program Groups at the End of Grade 1 
Method 

Two first grade classes which had received no programmed instruc- 
tion during the school year were selected for comparison with the combined 
six experimental classes on a series of arithmetic achievement tests given 
at the end of the year* The non»program (control) classes were chosen so 
that their combined mean IQ was as equivalent as possible to the mean of 
109.84 (s«14.24) of the total Program Group (N«121). The result of this 
selection procedure was a Control Group (N-38) with a mean intelligence of 
108*97 (s«12.15) which had received traditional Instruction in numbers and 
addition and subtraction from one of two experienced first-grade teachers, 
and had also received incidental teacher instruction in time-telling. 

One week before school ended the Control Group was administered the 
following tests on successive school days: the Metropolitan Achievement 

Tests (Primary I Battery) , which required five daily administration periods 
and included subtests of Word Knowledge, Word Discrimination, Reading, and 
Arithmetic; and the 90-item addition and subtraction test, described in 
Study 1A. The six experimental classes were administered the Metropolitan 
Achievement Tests and the addition and subtraction test during the same 
time period* Since these latter classes had taken the time-telling tests 
less than one week previous!'' as retention measures for Study IB, these 
tests were not readministered to them. 

Results 

Addition and Subtraction Tests . Since no differences were found 
among the T-P, P-T, and P-P groups in addition and subtraction performance 
in Study 1A, the three groups were combined into a single Program Group for 
comparison with the non-program Control Group. Table 1.9 presents the means 
and SB's of the two groups on the 90-item addition and subtraction test, 
and also on the addition subtest (45 items) and subtraction subtest (45 
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items) alone* Figure 1*11 shows the score distributions £or each group on 
the total t«at. Statistical tests are unnecessary to conclude that there 
are essentially no differences between group means on any of the three 
measures* The Program Group, which had essentially the usual amount of 
teacher instruction plus the program, did only as well as the group re- 
ceiving traditional instruction for the usual amount of time* Although 
many students in both group s achieved at a level close to mastery of the 
subject matter as measured by the test, scores greater than 90 Z being ob- 
tained by 802 of the Program Group and 73Z of the Control Group, the ex- 
tra time spent on the use of the program did not enhance learning of the 
addition and subtraction facts* 

Time-Telling Tests * The means and SD's of the total Program Group 
and the non-program Control Group for the written and oral time-telling 
measures are shown in Table 1*10* The Program Group data includes students 
who failed the time-telling pretest but received the program, and also stu- 
dents who were not included in the preceding study (IB) because they were 
absent for one or more of the tests administered* Including these students 
lowered the test means to those reported in Table 1*10* Even with their 
inclusion, it is quite apparent that the time-telling performance of the 
Program Group was superior to that of the Control Group. Statistical anal- 
yses indicate that the mean differences -were highly significant, with t 
values of 7*28 for the written measure (df/157, p<*001) and 5*78 for the 
oral measure (df/157, p<«001)* The score distributions are shown in 
Figures 1*12 and 1*13* The data, however, indicate need of program re- 
vision since only 15Z of the students obtained mastery (90Z or better) on 
the end-of-year tests* The program was given on a group basis and revision 
of this procedure seems to be required* 

Metropolitan Achievement Tests . Raw score and grade equivalent 
means and SD's obtained for the Control Group and the six experimental 
groups combined on each of the four Metropolitan subtests are presented 
in Table 1*11* Differences between the raw score means, analysed by 
critical ratio tests, were within the 0*5 limits of chance for all of the 
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Figure 1*11 Score distributions of control and program 
groups on addition and subtraction test* 
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Figure 1*12 Score distributions of program group on end- 
of-year time-telling test (N»121>* 
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Figure 1*13 Score distributions of control group on end- 
of-yeer time-telling test (N«38). 
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subtests (CR's ranging from .29 to 1.89) • The results indicate that the 
achievement levels of the program and non-program groups at the end of the 
first grade were equivalent in the three subject matter areas for which 
neither received programmed instruction; and were also equivalent in arith- 
metic achievement for which the experimental group received teacher in- 
struction plus programmed instruction during the school year. (Figure 1.14 
shows score distributions for each group on the arithmetic subtest of the 
Metropolitan Achievement battery.) Thus , using the program in addition to 
the teacher resulted in no additional gain, and the extra time spent on the 
program did not affect achievement in other subjects. 

Summary 



End-o f -the -year testing in the first grade and comparisons of the 
experimental classes with the control classes appeared to indicate the fol- 
lowing: (1) When both programmed instructional material and the teacher 

are employed to teach the same thing, there is a redundancy of effort so 
that no additional student achievement is attained. However, the effects 

of the program must be known so that the decision can be made as to where 

* v > 

the teacher needs to supplement the program and where the teacher can 
assume that certain knowledges have been taught so that more advanced 
learning can proceed. (2) When a program is used to teach a topic usu- 
ally not taught intensively by the teacher, it seems possible that the sub- 
ject taught C8n be learned and retained. (3) Additional time taken from 
the usual first grade curriculum for the use of programs in arithmetic 
topics did not result in decreased achievement in other areas as measured 
by the Metropolitan Achievement Test. 
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Figure 1*14 Score distributions of program and control 
groups on arithmetic subteat of Metropolitan 
Achievement Teat* 
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Arithmetic end Spelling in Grade 4 
Overview 

Thred studies were carried out at the fourth grade level , Involving 
a total of ten classes in programmed instruction. The subject matter 
taught by programming in this grade was (a) the multiplication and divi- 
sion facts, (b) Introduction to fractions, and (c) spelling. All three 
programs were presented in textbook form. The particular programs used were 
selected on the basis of the appropriateness of their content to the arith- 
metic and spelling curricula that were currently being followed in the 
schools into which they were introduced. 

Intelligence Effects upon Programmed Learning 

Programming has been recognized by educators and psychologists as 
one possible means for diminishing the dependency of learning upon intel- 
ligence as presently defined by standard tests. The hypothesized decreased 
relationship between intelligence and achievement is assumed to occur for 
several reasons. Consider, for example, the variable of '’learning rate." 
Since most intelligence tests have a speed component and most group-paced 
learning situations maximize individual differences in speed, the relation- 
ship between the common speed components would contribute to a positive 
correlation between the two. In contrast, most programmed instruction is 
self-paced and would minimize the effect of learning rate and tend to lower 
the correlation of learning achievement score with a speeded intelligence 
test. Secondly, it is assumed that in a well-administered program the stu- 
dents have mastered the prerequisite learning for taking the program. This 
should have the effect of reducing individual differences and lowering the 
correlation coefficient. Thirdly, if a program is an effective instruc- 
tional procedure io that more students achieve mastery (top-test scores) 
than with other instructional procedures, the range of scores is reduced 
and consequently the size of the correlation coefficient k decreased. 
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Investigations seeking to determine the raltionships between in- 
telligence test scores and the learning which occurs from a program have 
yielded varying results, with certain studies (Silberman, 1962 ) indicating 
no relationship between IQ measures and achievement while others (Shay 9 
1961 * Porter 9 1961; Smith 6 Moore 9 1961 ) have found at least a moderate 
relationship. The discrepancies among research findings regarding intel- 
ligence effects are probably due to differences in the programing situa- 
tions used in the various investigations, e.g. 9 differences in subject mat- 
ter, program construction procedure, program format, length of instruction, 
manner of presentation, and student population, as well as differences in 
definitions and measures of intelligence. Since differences such as these 
occur in various applications ©£ experimental learning situations in the 
classroom, it seems logical to expect that consistent results regarding the 
intelligence-programmed learning relationship are not easily obtainable. 

Detailed analysis of such differences requires systematic controlled 
study of the dimensions along which these differences vary. These dimensions 
consist of the components of intelligence and aptitude that are related to 
learning, as prerequisite knowledge, the presence of ®® learning sets'® which 
facilitate learning, and the ability to make the discriminations, e.g., 
spatial, abstract, linguistic, .etc., necessary to profit from instruction. 

In the absence of adequate knowledge of these dimensions, no generallsable 
conclusions can result from disparate single experiments. Simple empirical 
investigations can, however, obtain information on gross variables such as 
Intelligence test scores which are sensitive to gross differences in experi- 
mental materials and operations without establishing conclusive evidence 
for all situations. The accumulations of this type of research can accom- 
plish the following: first, provide information concerning the variable 
in question to potential users of the particular kind of material and con- 
ditions that were investigated; and second, if data from a number of inves- 
tigations performed under specifically described conditions are obtained, 
certain general characteristics regarding the effects of certain conditions 
upon the variable can be described and subjected to more detailed experi- 
mental analysis. 
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The first study in the fourth grade (4A) was of this empirical 
type, with the objective of evaluating the extent to which learning from 
an instructional procedure utilizing both programming and teacher presen- 
tation was influenced by the intelligence of the learners* The subject 
matter, taught in daily sessions over an 11-week period, was multiplication 
and division facts* Students in six classes worked in the program on four 
days of each week with each student being permitted to advance through the 
program at his own pace. On the fifth day, the teacher directed a general 
review and discussion of the material presented in the program. A corre- 
lation between intelligence and terminal test performance was obtained to 
assess the degree of relationship between IQ and achievement* Also, the 
achievement test performances of high and low Intelligence sub-groups were 
compared* 

Review and Acceleration 

The same six classes which participated in Study 4A were employed 
in investigating the use of programmed instruction as a review technique, 
and also as a technique for accelerating the fourth grade arithmetic cur- 
riculum (Study 4B)* Following the multiplication and division program, 
four of the six classes continued with the usual school curriculum for the 
remainder of the school year* Within this group, two of the classes re- 
ceived no further programmed instruction. The other two were given a re- 
tention test on the multiplication and division facts two months following 
the completion of the program, and individual students not passing this 
test were required to use the program as an aid in reviewing and relearning 
the multiplication and division material they had forgotten* The remain- 
ing two classes, constituting an accelerated group, began the fractions 
program (containing material not ordinarily presented at this grade level) 
soon after completion of the multiplication and division program, rather 
than continuing with the usual Grade 4 curriculum* Thus by the end of the 
year these latter two classes had been exposed to intensive instruction on 
a topic in which those following the usual curriculum had had only periodic 
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rod incidents! instruction* Achievement messures for si! dssses were com* 
pared st the rod of the school yesr to determine the relstive effects of 
the curriculum, the existing curriculum plus individual programmed review, 
and the sccelersted curriculum, upon the amount of arithmetic knowledge 
retained at the rod of Grade 4* 

Effects of Classroom Surroundings 

In Study 4C, a spelling program was used to evaluate the effect 
that variations in classroom environmental stimuli have upon learning* 

It is an increasingly common practice in present-day school systems to 
teach various subjects in classrooms specifically designed for instruc- 
tion in certain subject matter areas, e*g*, science rooms, language rooms, 
etc* The major reason for this practice is, of course, that special 
equipment too bulky or expensive to be put in the ordinary classroom is 
necessary for teaching certain subjects effectively. It may be, however, 
that other learning advantages, more subtle thro the use of special equip* 
■rot, accrue from the practice of using a specific room to teach only one 
subject matter* The presence of classroom stimuli such as charts or proj* 
ects completed, particular seating arrangements, and general "'classroom 
atmosphere" are often assumed by educators to have facilitating effects 
upon learning and retention* A room in which only one subject matter is 
taught usually has a variety of such stimuli, all pertaining to the single 
knowledge area* It is possible that the uniqueness of the surroundings, 
in itself, may facilitate the learning which takes place in such a room* 

This assumption is supported to some extent by certain laboratory 
investigations of human learning which have demonstrated that certain 
stimuli which are present in the total learning situation enhance learning, 
while other stimuli interfere with learning (Slamecka A Geraso, I960)* 

One theoretical explanation which accounts for these empirical findings is 
the concept of interference, which has received considerable research 

e 

attention (Postman, 1961) • A basic assumption in many theories of learning 
is that new responses being learned become attached to all stimuli present 
during learning, including incidental as well as critical stimuli* According 
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to the interference concept, if the incidental stimuli present are already 
associated with responses other than the one being learned, these older 
associations tend to interfere with the new one being Bade. This associa- 
tive interference hypothesis suggests that when several different subjects 
are being taught in the ease class room, the response appropriate to one 
subject nay be associated with classroom stimuli in a way which interferes 
with learning responses to other subjects. Therefore, a possible advan- 
tage of using different classrooms for different learning materials is 
that the unique surrounding stimuli present in the different classrooms 
are associated with only one subject matter, which may diminish interfer- 
ence effects upon learning. Also, once a response has become associated 
with these incidental stimuli, the presence of such stimuli may facilitate 
retention of material learned if a test is given in their presence, since 

they would tend to evoke the appropriate associative responses rather than 
interfering responses. 

Although this hypothetical explanation of possible effects of in- 
cidental stimuli upon learning is quite crude and general froai a rigorous 
point of view, it does represent a possible extrapolation of existing theo- 
retical descriptions of the learning process to educational practice, and 
suggests an initial experimental study. Consequently, Study 4C was per- 
formed to explore the hypothesis suggested by a general Interpretation of 
the concept of interference, namely, that incidental classroom stimuli 
will facilitate or inhibit learning of specific responses in accordance 
with whether or not the responses already associated with them interfere 
with the new responses required. Specifically, it was predicted that a 
group receiving both spelling instruction and spelling tests in a special 
room in which no other subject matter waa taught would demonstrate more 
learning than a group given the same instruction and testing in a room 
used by that group for learning other subjects as well. A third group , 
receiving spelling instruction in a special room but all spelling tests 
in the usual classroom, was used to determine the effect of surrounding 
stimuli upon test performance alone. It was predicted that test perfor- 
mance of the latter group would be lower than that of the group which re- 
ceived all tests in the special room. 



Study 4A: 

The Effect of Intelligence upon Programed Learning Achievement 



Method 

Subjects* The same six classes in the fourth grade were used for 
both Studies 4A and 41* The mean IQ of the 173 students in the combined 
classes who completed the study was 116.45 (salQ.91). 

Design and Procedure. In the first three weeks of school all six 
of the classes were given a general review of the arithmetic material 
taught in the previous year (e.g*, addition , subtraction , measuring, using 
large numbers). At the end of the third week t a multiplication and divl- 
slon test. Part A (MD-A) was administered as a pretest to assess level of 
achievement in multiplication and division operations prior to beginning 
the multiplication and division program. All six classes were then given 
the program, under identical conditions, over the next six weeks. In a 
typical week, a student worked at his own pace through the program during 
45-minute work sessions on Monday, Tuesday, Thursday, and Friday. On any 
of these programmed instruction days, if the student completed one of the 
ten blocks of material into which the total program was divided he was 
given a written test on that block before continuing in the program. If 
a student failed to achieve a score of at least 70X on any block test, he 
was required to work through that block of the program again and pass a 
re-test at the 701 level before he could advance to the next block. This 
procedure provided a check on individual progress, snd assured the teacher 
that students were learning the required material* 

The Wednesday sessions were teacher-instruction periods, during 
which the teacher presented review and prat dee materials relevant to the 
parts of the program which meet students had completed. The specific con- 
tent of these teacher sessions was specified in detail in the Teacher f s 
Manual that was constructed for the study, insuring that all classes re- 
ceived the same treatment on these days* 



As a result of the self-pacing procedure, some students finished 
the program before the end of the allotted six-week period, while others 
were unable to complete it within the designated time limit. Students 
finishing early were provided with enrichment materials, to be used indi- 
vidually during the sessions when others were still working in the program. 
These materials consisted of workbook exercises pertaining to the multi- 
plication and division facts presented in the program, as well as problems 
and activities which required applications of these facts. The slowest 
students in each class, for whom it was obvious that not enough class time 
was allotted for program completion, were required to take the program 
home several night during the last two weeks and work on It there as well 
as in the classroom program sessions. 

At the end of the six-week period, students in all classes were 
given the two posttests to evaluate the learning which resulted from the 
self-paced, combined program-and-teacher instructional procedure. One 
posttest (MD-A) was identical to the pretest, containing 25 of the multi- 
plication and division items in the arithmetic sub-test of the Stanford 
Achievement Battery, plus 15 similar items constructed by the experimenters 
and added to give she test a wider range. The second posttest (MD-B) was 
a 40-item sampling of the items used in the ten block tests. (The MD-A 
test included soma rather difficult items with larger numbers than were 
used in the program, while MD-B contains simpler facts plus some word 
problems. In general, MD-A was a more difficult test,) 

Results 



It was necessary to eliminate six students from the original group 
before performing the final analyses because of incomplete data due to ab- 
sence on critical test days. The pre- and posttest data for all six groups 
combined are shown in Figure 1,15 for MD-A, For the 173 students for whom 
complete data was obtainad, the correlation between intelligence scores and 
MD-A posttest scores was ,19, and the correlation of IQ and MD-B posttest 
was ,20, Taken alone, these low correlation values suggest that intelli- 
gence differences accounted for very little of the variance associated with 
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achievement performance following programmed instruction. However, inspec- 
tion of the MP-A pretest scores indicated that soma students already knew 
much of the programed subject-matter prior to the program, and many stu- 
dents obtained scores at or near the test ceiling on the tests administered 
after completion of the program. Of a possible score of 40 on each test, 
the posttest mean for MB-A was 81.81 (s*4.75) and for MD-B was 83.72 (s»4.83) 
The high posttest performances may have influenced the je values obtained 
because the ceiling effect, by reducing posttest variance, would in turn 
depress any correlation which included the posttest scores as a variable. 

Since the correlations obtained may have been affected by the test 
ceiling restriction, a second type of analysis which did not require corre- 
lation was made to evaluate IQ effects upon learning. High and * 3 w IQ 
groups with similar pretest performances were selected from the original 
group, and their posttest achievement levels were compared to determine if 
group differences in intelligence would affect terminal performance. In 
this analysis, the prediction being tested was that the intelligence differ- 
ence between the groups would not result in differences in posttest per- 
formance following programmed instruction. 

A high intelligence gtoup (Group H) was selected from the six 
classes according to two criteria: (a) each student had an Otis IQ score 

between 120 and 140, and (b) each student had a pretest MD^A score below 
20 (l.e., a score which was less than half of the total score on that test). 

A lower intelligence group (Group L) was also selected so that the group ^ 
had (a) an Otis IQ score between 90 and 110, and (b) a pretest HD-A score 
below 20. The requirement that the pretest score be less than half of the 
total possible score on the MD-A test insured that all students in both of 
the groups selected did not have adequate knowledge of the multiplication 
and division facts prior to taking the program, and also that all students 
had a considerable test range (at least 20 points) over which improvement 
could be demonstrated on the posttest. Group H was then compared with 
Group L on the MO-A posttest to determine whether IQ differences, as deter- 
mined by the Otis test, resulted in significantly different posttest per- 
formances following completion of the program. 
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Table 1*12 presents the means end SD*s for the intelligence 9 pye— 
teet 9 end poetteet scores of the students nesting the criteria for inclusion 
in Group H or L. Mean gains fron pretest to post test are also shown. 

Since the difference between the pretest aeans for the 28 students in Group 
H and the 27 students in Group L was not significant (t«1.74 9 df/53 t 
p >.05) t the groups were tested as sanples fron different intelligence 
populations which had the sane knowledge of nultiplication and division 
prior to receiving the program. Conparison of the differences in posttest 
neans and in naan gains yielded t values of 1.25 and .04 respectively, 
neither of which is large enough to reject the null hypothesis that the 
groups were fron the sans or equal achievenent populations following pro- 
gramed instruction. The large difference between the groups in intelli- 
gence apparently had no effect upon final achievenent perfornance or the 
anount of learning which took place in the course of progranned instruction. 
The results of this conparison and the correlation analysis are consistent 9 
indicating that intelligence as neasured by the Otis test had little or no 
relationship to the learning which occurred under the progranned instruc- 
tion conditions used in the present study. 

Table 1.12 

Means and Standard Deviations for ligh and Low Intelligence Groups 
on Measures of IQ and Achievenent in Multiplication and Division 



MD-A Test Scores 
40 itens 

IQ Pretest Posttest Gain 

Group K X a I s X s X s 

H 28 125.86 4.58 14.57 3.26 30.04 5.34, 15.46 5.35 

L 27 103.04 5.25 13.11 2.99 28.52 3.48 15.41 4.22 



i ERIC 

p 



Study 41: 

The Use of Programed Instruction for Review and Acceleration 

of Arithmetic Learning 



Method 

Design, After completion of the multiplication and division pro- 
graa 9 the six classes which had participated in Study 4A were divided into 
three groups of two classes each and used in Study 41, Two of the three 
groups were presented the arithmetic curriculum that was currently being 
followed by the school system, using teacher Instruction for the remainder 
of the year. In order to guarantee that all four classes in both of these 
groups were exposed to the same subject matter at the same time, the teach- 
ers followed weekly lesson plans which were outlined in a Teacher’s Manual 
specially constructed for this study. The plans Indicated what topics were 
to be covered each week, and the textbook and workbook units and pages to 
be used in presenting them. Within this framework, the only difference in 
treatment was that students in one group (Group R) received a programmed 
review of multiplication and division one month following the program, 
while the second group (Group NR) did not. The third group (Group F) was 
given programmed instruction in fractions soon after completion of the 
multiplication and division program. This latter treatment constituted an 
acceleration of the arithmetic curriculum, since intensive instruction in 
fractions was normally not a part of the fourth-grade subject matter at the 
schools participating in the experiment. At the end of the school year the 
three groups, and a control group which received only traditional instruc- 
tion throughout the fourth grade, were given a series of tests to determine 
the effects of acceleration and review upon arithmetic achievement. 

Subjects . An attempt was made to organise the intact classes par- 
ticipating into experimental and control groups which were equivalent on 
three independent measures obtained prior to the study: Otis intelligence 
test scores, scores on the arithmetic subtest vt the Stanford Achievement 
Tests, and battery median scores on the Stanford Tests. The latter two 
measures were presumed to be indicators of prior knowledge in arithmetic 
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and general academic achievement, respectively, both of which could be ex- 
pected to have at least a moderate influence upon the learning required in 
the study. Table 1.13 gives the means and standard deviations for each 
group on these measures, after eliminating all students who failed to com- 
plete the study because of moving or extended absence. The means of the 
groups are equivalent on each of the two pre-experlmental achievement mea- 
sures. It was not possible to arrange all classes into equivalent groups 
on the intelligence measures also. The IQ mean of Group NR is signifi- 
cantly higher than the means for both the Control Group (C.R.-2.70, p<.01) 
and Group P (C.R.«2.38, p^.05), and is beyond the .10 significance level 
wher compared to Group R (C.R-1.79, p<.10). All differences in intelli- 
gence means between Group R, Group F, and the Control Group are well with- 
in chance limits, however, with CR ( s ranging from .46 to a maximum of 1.09. 

Procedure. Groups R and NR received identical treatments with one 
exception. One month after completion of the multiplication and division 
program. Group R was readministered the MD-A test (described in the previous 
study) as a retention test. Any student failing to achieve a score of 80Z 
or higher on the retention test was required to work through the sections 
of the multiplication and division program which taught the materials he 
had either forgotten or else had not learned previously. This use of the 
program as a review and relearning tool took place at home by the individ- 
ual students requiring it, while the group continued with the on-going cur- 
riculum in the regular daily arithmetic class periods. During this time 
Group NR received no retention test or review, but simply continued with 
the teacher-directed curriculum normally employed at the school. 

Group F, receiving an accelerated curriculum with programmed in- 
struction, began working on the fractions program three weeks after com- 
pleting the multiplication and division program. (A vacation, followed 
by a period of teacher instruction on two-figure multipliers, occurred 
during the three-weak interval between programs.) After administration of 
the 50— Item prete&t to determine existing knowledge of fractions, the frac- 
tions program was ad m ini stered over an eight-week period by the same gene- 
ral procedure as was used for the multiplication and division program. 
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Table 1*13 

Group Size, and Means and Standard Deviations of the Grade Four Arithmetic 
Groups on Measures of IQ, Arithmetic Achievement, and General 
Academic Achievement Taken Prior to Beginning Study 4B 



Group 


N 




IQ* 


Arithmetic 
Achievement ** 


Academic 
Achievement *** 


X 


■ M 


X 


8 


X 


s 


F 


56 


119.55 


12*69 


4.72 


.77 


5.03 


.82 


R 


65 


115*48 


9.23 


4.97 


•80 


4*91 


*91 


NR 


52 


114*33 


10*00 


4.76 


.71 


4*93 


• 81 


Control 


59 


113*39 


11.70 


4.79 


•S3 


5.15 


.94 



*Otis Quick-Scoring Mental Ability Tests (alpha) 

**Arithmetic subtest of Stanford Achievement Battery (grade- 
placement scores) 

***Battery Median of Stanford Achievement Battery (grade- 
placement scores) 

On four days of each week, students worked in the program on a self-paced 
basis, taking block tests as necessary and repeating the block if test 
performance was below criterion* Arithmetic sessions on the fifth day of 
each week were devoted to practice and review under the teacher* s direc- 
tion, using small groups that were relatively homogeneous in their rates 
of progress through the program* 

Upon completing the fractions program. Group F received teacher 
instruction In other arithmetic topics usually taught in the fourth grade 
for the remainder of the year* In this phase, however, the rate of prog- 
ress scheduled in the Teacher's Manual was considerably faster than the 
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rates of Groups E and NR, with the consequence that all three groups ended 
the school year at the sane point In the text being used* Thus Group F 
had covered (in a shorter time) all major arithmetic materials covered by 
R and NR, and in addition had been exposed to eight weeks of intensive 
instruction in an advanced topic* The total time spent on arithmetic was 
equal for the three groups. 

At the end of the year, all three groups were given the following 
tests: the two multiplication and division tests, MB-A and MD-B; the frac- 

tions test; and the Stanford Achievement Battery. The Control Group, 
which received no programming at all during the year, was also given all 
of the tests* 

Results 

The three experimental groups had each completed the multiplication 
and division program, and taken the MB-A and KD-B tests, just prior to the 
beginning of the acceleration study* Since the intelligence mean of Group 
NR was higher than the other two groups, the three groups were first com- 
pared on these MB-A and MB-B tests to determine if intelligence differences 
were producing a systematic effect upon the group performances at the start 
of Study 4B* Table 1*14 gives the means and SB's of each group on the MB-A 
and MB-B measures that were administered prior to the beginning of the 
study* An analysis of variance indicated no significant differences between 
the groups on the MB-B test (F<1*00, df/2, 170, p>*05), but a signifi- 
cant difference among the groups was found on the MB-A test (F®3.52, df/2, 

170, p<*03), due to the low mean of Group NR. Although having the higher 
intelligence score, the NR group was significantly lower than Group F (t*2»78, 
df/106, p<*01) on the achievement measure taken following administration 
of the multiplication and division program* These data add support to the 
conclusion reached In Study 4A, that XQ had little effect upon programmed 
learning, and suggest that the XQ differences among the groups may be ig- 
nored in analysing the results of Study 4B* 

The results of the five tests administered at the end of the school 
year are presented in Table 1*15* Variance analyses of the Stanford Battery 
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Median and the Stanford Arithmetic subtest results showed that differences 
among the four groups were not significant for either measure (F®1.37 and 
2.23, respectively, df/3, 228, p>.05). The equivalence of all groups on 
these standardised tests indicates that they had advanced to equal degrees 
during the school year in terms of general academic achievement, and also 
ie number reasoning and general arithmetic facility as measured by the Stan- 
ford sub tests* There is no indication that the groups were not comparable 
in the ability to learn* 



Table 1.14 

Means and Standard Deviations for Groups F, R, and NR on the MD-A 
and MD-1 Tests Administered Upon Completion of the 
Multiplication and Division Program 



Group 


N 


MD-A 

Total Possible-40 


\ MD-B 

Total Possible-40 






X 


8 


X 


s 




F 


52 


32*40 


4.77 


33.94 


4.51 




R 


65 


31*54 


5*10 


33*85 


5*28 




NR 


56 


30*04 


3.95 


33*36 


4.55 





In contrast to the equivalence found among groups on the standard- 
ized tests, reliable differences were obtained when the more specific tests 
evaluating the programmed materials were analysed* The analysis of variance 
for the MD-A test was significant < 9 * 3 * 53 , df/3, 228, p *.05) , with further 
t tests showing that the Control Group mean was significantly lower than the 
Group F and Group R means beyond the .02 level (£»2.83 and 2*50, respect 
timely) • For the !D-B test, it is apparent from Table 1*15 that the 
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variance of the Control Group ie mch larger than the variances of all the 
experlaental groups. Also, the Control Croup aean on the MD-B test was 
significantly lower than the F, R, and NR groups (t« 3,74, 5*62, and 4.70^ 
respectively), at levels beyond p*.01 in every case* Alaost without ex- 
ception 9 then* the end-of-year performance of the Control Group was in- 
ferior to all of the experiaental conditions on the aultiplication and 
division tests. However , no significant differences aaong the three ex- 
periaental groups were found on these tests. The latter finding fails to 
support the expectation that the use of the prograa as a review and re- 
learning tool in Group 1 treataent would facil: 

aent in aultiplication and division .~ This finding aay in part be dic- 
tated by the fact that the aean of each group was very near the test 
celling and that the test did not account for sufficient variance aaong 
individuals. 

Analyses of the fractions test data showed that Group F perforaance 
was superior to all other groups. The t, values obtained in coaparlng the 
Group F aean with Groups NR, R, and the Controls were 6.88* 6.83, and 6.06, 
respectively, each of which is well beyond the .001 level of significance. 
The lower SB of Group F relative to the others Indicates that its superior 
achleveaent in this topic was quite consistent aaong the students who took 
the fractions prograa. Further t, tests gave no evidence of significant dif- 
ferences aaong the NR, R, and Control groups. The score distributions on 
the fractions pre- and post tests are shown in Figure 1.16. The N in this 
distribution is 45, since fractions pretests were available for only 45 
of the 52 students in Group F. Figure 1.17 shows the fractions posttest 
for the R and NR Groups coabined. 

The finding that the group receiving a prograa in fractions psr- 
foraed better in fractions than those who did not is not surprising in it- 
self. However, Group F spent eight weeks of arlthaetle periods learning 
the additional advanced aa«,t lal, necessarily taking away learning tiae 
froa the usual fourth-grade a. Ithaetlc activities in which the remitting 
groups were engaged, and yet gave no evidence at the end of the year that 





or retained lets of the other arlthaetle topics ordinarily 
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taught In Grad* 4. Tha fact atrongly auggaata that accalaratlon of tha 
curriculun producad a significant aaeuht of additional arlthaatle loaning 

without balng datrlaantal to tha loaning and retention of tha notorial 
ill the atandard currlculus. -v 
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Table 1.15 




NUMBER CORRECT 



78 



Protest Post-tost 




NUMBER OF STUDENTS 



VigoM 1,18 Protest and post test scoros on fractions tost 
Group F 0H45) , 
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Figure 1.17 Distributions for Groups 1 and 111 (M«12l) 

on fractions posttast. 
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Study 4C: 

Effects of ClMiroes Surroundings Upon Programmed Learning in Spelling 
Method 

Design * Three groups , teking e full year's programed spelling 
course, were used in this study* One group (Group H) received programed 
instruction and all weekly spelling tests in teh sane honeroon used for all 
other instruction* A second group (Group S) received all programed in- 
struction and all weekly spelling tests in a special room, used for no 
purpose by this group but learning spelling* The third group (Group S-H) 
received the program in a special rooa set aside for spelling instruction 
only, but took all weekly spelling tests in its honeroon* These groups 
were conpared on a series of spelling tests given at the end of the school 
year to determine if prograaned spelling achievement is influenced by vari- 
ations in the surroundings present during learning and testing* A Control 
Group, receiving traditional spelling instruction in its own honeroon, was 
also conpared with the experimental groups to evaluate the effectiveness of 
programed instruction in teaching fourth grade spelling* 

Subjects * TWo of the six classes chosen to participate in Study 
4C were also participants in the Arithmetic Studies 4A and 4B* Four other 
classes were selected so that, when combined into two more groups of two 
classes each, the resulting three groups were equivalent in terms of mean 
IQ, mean spelling achievement level, (as measured by the spelling subtest 
of the Stanford Achievement Tests), and mean level of general academic 
achievement (as measured by Stanford battery median scores)* A Control 
Group, consisting of two classes equivalent to the experimental groups on 
these same measures, was also selected. It was necessary to eliminate some 
students (about 4X from each experimental group) when making the final 

analyses, for reasons such as extended absence or transferring schools 

6 

during the course of the experiment* 



6 

For this reason, the else of Group S in Study 4C differs slightly 
from the same group used in 4A and 4B* Students that had to be eliminated 
from one study were not necessarily eliminated from all others because of 
differences in length of the studies, time of year, etc* 



so 



Table 1*16 describes the four groups used in the final analyses 9 
listing their sises and the means and SD's of the independent variables 
on which they were matched. As was the case in Studies 4A and 4B 9 the 
three groups in 4C were bright-normal in intelligence 9 and grade placements 
on the Stanford spelling subtest and the total Stanford battery indicated 
that their achievement levels were considerably above average at the begin- 
ning of the fourth grade. Statistical tests for differences between groups 
on the various Independent measures did not reveal any significant differ- 
ences 9 so the groups were assumed to be equivalent on all measures taken 
at the beginning of the school year. 

Procedure . In the first week of school the three experimental 
groups were given additional pretests to assess level of spelling achieve- 
ment prior to beginning the study. The Program Pretest consisted of 60 
words randomly chosen from the 354 new words presented in the program that 
was used. This test required the students to write the words as they 
were pronounced by the teacher. The other pretest given was the Spelling 
subtest of the Iowa Tests of Basic Skills (Porm 1).^ The Iowa pretest 
contained 38 multiple-choice items 9 each of which required the student to 
indicate on a special answer sheet which of the four printed words was 
spelled incorrectly. 

Following the pretests 9 the experimental groups began a 29-week 
period (out of a total of 37 school weeks) of programmed instruction in 
spelling. The general procedure for all groups was to work on assigned 
frames during scheduled 20-minute class periods on Monday » Tuesday 9 and 
Wednesday of each week. On Thursday the teacher directed a review and en- 
richment period which provided further practice with the words presented 
in the week's assignment 9 and on each Friday students received a written 
test of the words covered during the week. Exceptions to this procedure 
occurred on five occasions 9 usually close to a vacation period, at which 
times the weekly tests were postponed until the next school week. In all 9 
each group received 24 weekly tests. 
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Iowa Tests of Basic Skills , 



Boston: Houghton-Mlfflin 9 1955. 
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Weekly assignments were specified for ell teachers in a Teacher's 
Manual specially constructed for the study* The assignments averaged about 
120 frames , an amount which made it necessary for students to complete ap- 
proximately 40 frames during each 20-minute program work period* At the 
beginning of each week students were told the frame numbers which consti- 
tuted the week's assignment , and then were permitted to work at their own 
paces* Faster students who finished in less than the three 20-minute per- 
iods allotted were given individual spelling enrichment tasks by the teacher* 
Those in danger of not finishing an assignment in the allotted three-day 
program period were given extra time to insure that they would be able to 
participate in the teacher-directed enrichment period which followed on the 
fourth day* Suggested activities for this latter period were given in the 
Teacher's Manual , and teachers were asked to follow these suggestions to 
minimize differences among the groups* 

The number , of words presented per week in the program varied from 
16 to 20, in accordance with the length of the assignment made* Some words 
were repeated on several different weeks because the program contained per- 
iodic word reviews as well as new words throughout* 

Within this general framework, the experimental conditions for eval- 
uating the effects of classroom stimuli upon learning were arranged as 
follows: Group H received all instruction and testing in the same class- 

room in which it received all other instruction (at this grade level classes 
were self-contained)* Group S-H received programmed instruction and 
teacher-directed enrichment in a separate room, used only for learning 
spelling* All weekly tests and the final post tests were administered in 
the homerooms of these Group S-H classes, however* Finally Group S received 
all instruction, and all tests as well, in a special spelling room which 
it used for no other purpose* (The special rooms used by the latter groups 
contained no displays, exhibits, or other material associated with any 
topic other than spelling*) The Control Group followed the usual spelling 
curriculum in the regular classroom, using the standard curriculum* This 
curriculum contained 112 of the 354 new words presented in the program, 
plus other words Which were generally less difficult than those on the 
programmed spelling list* 
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Table 1.16 

Group Size, and Means and Standard Deviations of the Grade Four Spelling 
Groups on Measures of IQ, Reading Achieveaent , and General 
Academic Achieveaent Taken Prior to Beginning Study 4C 



Group 


N 


* 


IQS . 


Spelling 

Achieveaent** 


General 

Achieveaent*** 




X 


S 


X 


s 


X 


s 


H 


47 


114.17 


14.62 


5.07 


1.08 


4.77 


•88 


S-H 


67 


115.78 


9.18 


5.01 


•92 


4.89 


.90 


S 


55 


114.95 


11.35 


5.21 


.98 


4.86 


.89 


Control 


59 


113.39 


11.70 


5.45 


.88 


5.16 


.94 



*Otls Quick-Scoring Mental Ability Tests (alpha) 

**Readlng subtest for Stanford Achieveaent Battery (grade- 
placement score) 



***Battery Median of Stanford Achieveaent Battery (grade- 
placeaent score) 

Upon completion of the prograa, the three experimental groups and 
the Control Group received three posttests assessing spelling achieveaent. 
The teats used mere the saae Program and Iowa tests administered to the 
experimental groups prior to beginning the study, and the Spelling subtest 
of the Stanford Achieveaent Battery. 

Results 

Pretests. Means and SB's of the two pretests* mhich mere adminis- 
tered to the three experimental groups to assess their equivalence in pre- 
experiaental spelling achievement* are presented in Table 1.17. Critical 
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Table 1.17 

Mesne end Standard Deviations for Groups H t S-H, and S on the 
Iowa and Program Spelling Pretests 



lows Pretest Program Pretest 

Group N (38 items) (60 items) 







X 


8 


I 


8 


H 


47 


20.70 


7 • 86 


31.28 


14.07 


S-H 


55 


19.67 


8.56 


35.51 


11.38 


S 


67 


20.64 


7.01 


34.46 


10.88 



ratio tests showed that mean differences among all groups were within the 
•05 limits of chance on both pretests, indicating that the groups were 
equivalent in spelling performance at the beginning of the study. 

Posttests. Table 1.18 contains the data for all of the spelling 
posttests that were administered to Groups H, S-H, S t and Controls at the 
end of the school year. Figure 1.18 shows pre- and post tests for the pro- 
gram groups and Figure 1.19 shows post tests for the Control groups. Anal- 
yses of variance were performed for each of the three tests to determine if 
differences among the groups were reliable. The F values obtained for the 
Stanford and Iowa posttests were both less than 1.00, indicating that all 
groups were equivalent in spelling performance on these two measures* On 
the Program posttest, however, am F of 10*26 was obtained, which is signif- 
icant at the .001 level of probability with df/3, 224. Further jt tests 
between the group means on this test showed that the Control Group perfor- 
mance was significantly lower than that of all three of the groups which 
had received the program (the & values were 4.46, 3.76, and 6.10 for com- 
parison of the Controls with Groups H, S-H, and S, respectively, with 



84 



p< .001 1.81 each ctic) * The Jt values obtained when the program groups were 
compared with each other were .21, .59, and 1.01, none of which is large 
enough to reach the .10 level of significance. 

Summary 

These data indicate without exception (a) that the experimental 
variations in stimulus surroundings had no differential effects upon end- 
of-year spelling achievement of the experimental groups; and (b) that the 
use of a program for spelling Instruction resulted in achievement equal to 
the control classes as measured by two standardized spelling tests, and 
facilitated spelling performance of the program groups relative to tradi- 
tional instruction on a test which sampled the specific words taught in 
the program. Little can be said about the first result, except that the 
hypothesis that the presence of incidental classroom stimuli affects learn- 
ing was not supported under the conditions used in this experiment. Con- 
cerning the second finding, it seems useful to point out that the Program 
tests, consisting entirely of words taught in the spelling program, con- 
tained many words, 39 out of 60, which students in the Control Group did 
not encounter in the course of their traditional fourth-grade spelling in- 
struction. While this fact explains the lower Control Group performance 
on the Program test, it also indicates that the program groups, by being 
required to do so, were able to learn more spelling during the year than 
were the controls. The additional material apparently did not prevent the 
program groups from learning the words usually required at this grade level, 
since students receiving the program performed as well as control students 
on the standardized tests. Had a more comprehensive evaluation been made, 
including all of the words to which each group was exposed during the 
entire year's spelling instruction, more definite information would have 
been obtained concerning the spelling efficiency resulting from the program 
and control conditions. Unfortunately, the amount of class time required 
for such an evaluation made it prohibitive in this study. The present re- 
sults suggest, however, that further research Involving morro comprehensive 
testing would be fruitful in indicating the quantity of spelling material 
students at this grade level can retain following exposure by programming 
and traditional methods. 
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Table 1.18 

Means and Standard Deviations for Groups H, S-H» S, and Controls 
on the Stanford Spelling, Iowa Spelling, and Program Spelling Teate 
Administered at the Sod of the School Tear 

‘jK 

' ■ i r '"* , ' ; . ;v 



Group 


N 


Stanford 


(38 &«•) 


.V,*V ...... 

Program , 
(60 items) 




X 


a 


X 


a 


X 




a 


E 


47 


5.34 


.87 


27.87 


6.59 


52.83 




7.73 


S-H 


55 


5.64 


.90 


28.71 


6.06 


53.24 


11.13 


S 


67 

t/ 


5.61 

i 

* «* 


.84 


28.03 


5.44 


54.21 




6.83 


Control 


59 


* 

5.57 


.99 


28.88 


6.02 


46eS8 




7.31 
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Implications 

The specific conclusions of each study have been reported above in 

the separate studies; the broad inpllcatlons that can be gathered are the 
following: 

!• There is extensive variation in rate of learning aaong students 
when they are given the opportunity to proceed at their own rates with pro- 
gramed learning materials . 

2. Pretest scores show that nany of the students know the subject 
being taught and that sone students are not ready to learn it. 

3. Different types of teacher-program combinations in several 
grades nade little difference in student achievement. 

4. Young children can be taught a subject intensively with little 

loss in retention (at least over the short time measured in the time-telling 
study). 

5. The extent of the correlation between general intelligence and 
achievement as a result of programmed instruction depends upon the particu- 
lar program involved. In general , intelligence appears to be related to 
the pace with which the student goes through a program. 

6. Extension of the curriculum with programmed materials, neces- 
sarily taking away from tine spent in conventional grade-level instruction, 
produced additional learning without being detrimental to the learning of 
materials usually taught at that grade level. In general, students required 
to learn more did learn more. 

Host impressive in these studies was the wide variation in student 
rate of learning and the wide variation in student achievement prior to 
instruction. As a result, attention in subsequent academic years at the 
Baldwin-Whltehall Schools was focused on the individualisation of instruc- 
tion. Some Initial pilot studies, undertaken prior to the establishment of 
an experimental individualised elementary school, are reported in Chapter 4. 
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CHAPTER 2 

THE IMPACT OF PROGRAMED INSTRUCTION ON 
SELECTED STUDENT VARIABLES 

C. M. Llodvall 1 

Introduction 



The studies reported in this chapter ere concerned with e variety 
of student variables , with what changes take place in then and how they 
relate to one another uhen students use programed instruction under certain 
conditions. The variables studied include student attention, attitude, 
aptitude, reading ability, speed in working through a program, and selected 
measures of achievement* The studies will be reported under two major 
categories: 

1* Changes in student attention and attitude over an extended 
period of use of programmed materials. 

II* An analysis of the relationship between achievement and 

aptitude when various measures are employed under a variety 
of instructional conditions. 

The data presented here must, for the most part, be considered as 
descriptive data. That is, they provide a description of what happens to 
certain student variables when programmed instruction is used on a broad 
scale in rather typical on-going school situations* As a result, it is 
possible to present data bearing on several important hypotheses; but it 
is impossible, due to limitations in sampling and in the way in which stu- 
dents could be assigned to various situations, to present rigid tests of 
these hypotheses* Where tests of statistical significance are provided, 
it has been largely to provide evidence concerning the internal validity 
of the results. In other cases only the descriptive statistics have bean 
provided. Despite these limitations, these studies should be of considera- 
ble interest and importance since, in general, they are based on more 



Hfith the assistance of Lois Lackner, Joseph Ferderbar, Ji 
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Studios of Pupil Attention and Pupil Attitude 

Tboro is sons season to feel that when a pupil ie studying with a 
good progran hie degree of attention to tits instructional naterial should 
he greater than it would be ie the typical instructional situation. Con- 
tributing to this internet should be the fact that the etudeat is experi- 
encing steady reinforeenent as he receives feedback concerning the correct- 
ness of his responses and the feet that he is being pernitted to progress 
in the learning activity at his own pace. Of course, the extent to which 
the use of a progran holds the interest of a student is going to depend 
greatly upon the quality of the specific progren, but nany researchers in 
studying the use of programed naterials in relatively United or labora- 
tory-type situations have reported a high degree of interest aeong subjects. 

On the other hand, nany critics claia that asking a student to sit 
at a desk day after day, turning the pages of a programed textbook and 
reading a seeningly endless succession of similar frame, will crests a 
situation that will quickly bacons extremely boring. Alsoi eons teachers 
who have used progress in this way report that this boredoa does result. 

In view of this situation it would aeon to be important to inves- 
tigate this variable of pupil attention and pupil attitude under varying 
procedures for using program and at various grade levels. This is the 
purpose of the studies described in this section of the report. As masures 
of pupil interest, the studies here employ two procedures: (1) a record 

of pupil inattentiveness obtained through observation, and (2) measures 
of pupil attitude obtained through the use of specially constructed atti- 
tude scales. 

Studies of Pupil Inattentiveneas 

Studies of overt nanlfestatlons of pupil laatteatlveness were car- 
ried out with three different groups : (1) six classes of first graders 
using the tine-telling progran, (2) five classes of fourth graders using 
the nultlpllcation and division program, and (3) six classes of fourth 
graders using the spelling progran. 
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A stature of inattentiveness for a data vat obtained by baring an 
observer eit in the classroom and, at two-minute intervale , make a quick 
count of the maker of students not giving overt attention to the naterial 
they sere supposed to be studying (l.e* t were goring about the root, watch- 
ing another student , day-dreaming, etc*)* To obtain a Measure for a class 
at a particular stage in its use of the program, the class was observed for 
a period of approximately one-half hour on each of the indicated days. This 
■assure used was obtained by determining the mean number of students inat- 
tentive at any two-minute time interval over the observation period and con- 
verting this to a percent of the total number of students in the class* 

Every class that was observed while using prograomed materials was 
also observed, on the same day 9 while it was studying some type of non-pro- 
grammed materials* This permitted a comparison of attentiveness under the 
two conditions* Also 9 each class was observed on a seriee of designated 
days spaced out over the weeks or months that the program was used* This 
permitted a study of changes in attentiveness over time both in program and 
non-program classroom situations* 

In the following sections sunmarislng the results when this type of 
study was carried out with groups using the three different programs 9 pro- 
vision is made for comparing Inattentiveness under programmed and non-pro- 
gronmed conditions and for noting any trends in inattentiveness over time* 
Also, data are presented on the interaction between study conditions and 
time* In each ease an analysis of variance has been used to test the sig- 
nificance of the results* It is 9 of course, recognised that since there 
was no random selection of programs used or of the classes involved, the 
generalisations that can be made from any one study are quite limited* How- 
ever, the significance tests provide some indication of the "Internal va- 
lidity" of the results, and the findings should be useful for suggesting 
hypotheses for more definitive studlee* 

Inattentivenees A mong Elrst-Grade Students Heine a Tlme-Telli «i« *ra»rmm 

Six first-grade classes in three different schools were observed 
while they worked through the time-telling program and also while they worked 



95 



at non«pro|raaid iMt work* In studying tbs progran s pupil worked through 
s sspsrsts booklet during each of tbs 14 periods tbst bs devoted to this 
■at oriel. At spy given session* tbs teacher uould first have tbs class* as 
a group* read and respond orally to tbs first few freest. Following this* 
eaeb pupil would work on his own until be had conpleted specified sections 
of the booklet. There were sons differences aaong the six classes in the 
way in which study sessions were spaced but since a prellalaary analysis 
of the data indicated that these differences were not related to the naan 
urea of inattentlveness* the results fron all six classes were analysed to** 
gather. In every class* 14 separate study periods were spent on the progran. 

To get a picture of changes in inattentlveness* each class was oh** 
served during the first session* the fifth session* the ninth session* and 
the fourteenth session. The classes were also observed on these sene days 
while they were doing non-progranned seat work. 

Tables 2.1 and 2.2 susnarise the analysis of the inattentlveness 
■ensures for this study. Fron this it can be seen that there is a signifi- 
cant difference between the two conditions and that the students are wore 
attentive when studying the progressed aaterlals. However* there is no 
difference aaong the eesslons end no Indication of a trend over tine under 
either of the conditions. 

, Inattentlveness iwmi Fourth-Grade Student* Osina an A rlthnat lc Proeran 

Five fourth-grade classes in three different schools were observed 
while they were using the aultlpllcation and division progran and also while 
they were doing seat work with notarial that was not progressed. The classes 
used this progran on a dally basis and devoted about 45 ninutes per day to 
this type of study. Students were permitted to work at their own pace and 
approximately eix weeks were spent on the progran. The classes were ob- 
served at the end of the first* second* fourth* and sixth weeks. Ths sched- 
ule of observatlone for this particular study involved observing the clasees 
on two consecutive days at the four tines indicated. Bach inattentlveness 
■ensure is therefore an average for two consecutive days. The classes were 
also observed on these sane days while they were doing sene non-progranMd 
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Table 2.1 

Mean Xnattentivenees Measures Ondar Prograaid and Mon-Frograaaed Study 
Conditions for Sin First-Grade Classes Using tbs Tine-Telling Prograa 








Mean Percent of Studinte Inattentive 




SbUMIJ VVUIAAbAVU 


. First 
Session 


Fifth 

Session 


ninth 

Session 


i ' >; i. v ; 

Fourteenth 

Session 


All 

Sessions 


Programed Work 


5.42 


5.15 


4.71 


5.27 


5.14 


Non-Prograaaed Work 


10*90 


13.81 


10.97 


14.08 


12.44 


Both Conditions 


8.16 


9.48 


7. 84 


9.68 


8.79 



Table 2.2 



Smeary of Analysis of Variance of Inattentiveness Measures for 
Six First-Grade Classes Using the Tine-Telling Prograa 



Source 


Sun of Squares 


df 


Mean Square 


F 


Prog, vs Ion-Frog. 

f 


6.4020 


1 


6.4020 


41.26** 


Srror (Bet. Cl.j; pooled) 


1.5S08 


10 


•1551 




" L ' » 

Aaong Sessions 


‘ * ■ ■ * * . • }’*: t 

.3074 


3 


.1025 


Less than 1 


Sessions X Prog • -Son-Prog • 


.2963 


3 


.0856 


less than 1 


Srror (less X Cl. $ pooled)" 


* 3.4879 


30 


.1163 




Total • ( ? • 


12.0094 


47 




* 



♦♦Significant at .01 level 
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••at work. This design again permitted a study of differences in attentive- 
ness under programed and non-programmed conditions and a study of changes 
over tine. 

Tables 2.3 and 2.4 susnarise the analysis of the inattentiveness 
aeaeures for this study. Iron this it can he seen that there is a signifi- 
cant difference In inattentiveness between the progressed and non-programed 
conditions and that there is less Inattentiveness when programed Materials 
are being used. Also* the difference among sessions is significant. It 
can be seen that here there is a definite trend* under both conditions* 
toward an increase in Inattentiveness with the passage of tine, and that 
the interaction of sessions and treatments is not significant'. 

Inattentlvenasa Among Fourth-Grade Students Uslns a Spelling Program 

Six fourth-grade classes in four different schools were observed 
while they were studying the spelling program. These classes used this pro- 
gram for an entire semester* devoting about IS to 20 minutes per day for 
five days a weak to the study of spelling. Three days each week were de- 
voted to the study of the program* with one day used for testing* and the 
other for teacher-directed "enrichment" activities. Each pupil was required 
to cover the same number of frames per week but was permitted to progress 
through the week's work at his own pace. The classes were observed at the 
end of the first week* at the end of the second week* at the end of the 
first month* and at the end of the semester. Each class was also observed 
on these same days during a period when pupils were doing non-programed 
seat work. Data were analysed to determine differences In Inattentiveness 
between the programmed and non-programmed situations and any changes during 
the course of the semester. 

Tables 2.5 and 2.6 summarise the analysis of the inattentiveness 
measures for the classes that used the spelling program. From this it can 
be seen that inattentiveness is significantly greater under the condition 
of non-programmed study. In this situation there was no evident trend in 
inattentiveness as the semester progressed. 
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Table 2.3 

Mean InittmtlvMMi Nuturu Mr trogroMd and Xon-Programed Study 
Conditions for Ww Fourth-Grads Clasaas Studying an Arithmetic Frogran 




Moan Psrcant of 



Inattentive 



oruoy umeiuou 


Snd of 
1st ipik 


Bad of 
2nd *Mk 


Snd of 
4th week 


Sad of 
6th mak 


All 

Sm.Ioh. 


Frogran d Work 


3.72 


5.18 


6.90 


9.36 


6.29 


If on-Pregnaned Work 


9.04 


9.74 


9.58 


11.42 


9.95 


Both Conditions 


6.38 


7.46 


8.24 


10.39 


8.12 



Table 2.4 

Sumary of Analysis of Variance of Inatteatlveness Maaauraa for 
Viva Fourth-Grads Classes Studying an Arithmetic Frogran 



Source 


Sun of Squares 


df 


Mean Square 


F 


Frog, va Won-Frog. 


1.3359 


1 


1.3359 


11.8** 


Error (Bat. Cl.; pooled) 


•9054 


8 


.1132 




Among Sessions 


•8631 


3 


1 •: 

.2877 


10.7** 


Sessions X Prog. -Woe-Prog. 


.1771 


3 


•0590 


2.19 


Error (Sets X Cl. ; pooled) 


•6447 


24 


•0269 




Total 


3.9282 


39 


•• , , V 





significant at *01 level 
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' ?tblt 2.5 

Man Insttantiusnass Maiuni Under FrograMd and Mon-Prograaaad Conditions 
for Six Fourth-Grads Classes Going tha Spalling Prograa 



Study Conditions 




Naan Fareant of Students Inattentive 




Bnd of 
1st week 


Bnd of 
2nd mask 


Bnd of 
1st month 


Bnd of All 

Saaester Sassions 


Frogrsaaid Work 


4*30 


3.73 


3.10 


4.85 


4.00 


Mon-Progrsanad Work 


10,02 


9.15 


8.50 


9.78 


9.36 


Both Conditions 


7.16 


6.44 


5.80 


7.32 


6.68 



Tahla 2*6 

Suaaary of Analysis of Varianea of Xnattsntiaenass Maaauroa for 
Six Fourth-Grads Claaaas Using tha Spalling Frogran 



Sourca 


Sua of Squares 


df 


Naan Square 


F 


Frog, as Mon-Frog. 


3.4381 


1 


3.4381 


26.17** 


Brror (Bat. Cl. { poolad) 


1.3139 


10 


.1314 




Among Sassions 


.1578 


3 


.0526 


Lass than 1 


Sassions X Frog .-Mon-Frog. 


.0276 

J 


3 


.0092 


Lass than 1 


Brror (Sass X Cl.; poolad) 


2.3408 


30 


.0780 




Total 


7.2782 


47 
















AASignifioant at *01 level 
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DllCUIliOll 8 Stlidill of Pupil InatjjjMiiii>|j||g 

It would probably bo impossible to design • study to onswor tht 
general question of whothor prograowd aaterlals sro aore or loss offset ivo 
in bolding pupil ottontlon than sro otbor study aotoriols. This question 
eon bo answered only in toras of spoelflod progroas and specified alterna- 
tin aotoriols. 

However* tbs throo studios reported boro do provide soao ovldonco 
witb respect to tbo question. Hero three different progroas were involved 
end three different plans for using the aotoriols were followed. 2 In oil 
three coses the students were significantly aore attentive when studying 
the progroas. AliOi in two of the three studies there was no trend toward 
inettentiveness os students becaae aore eeeustoaed to studying froa the 
progrsa. In the one ease where students beesae aore inattentive with the 
passage of tiae this increase was seen both when they were studying programed 
and non-prograaaed mater loir. 

Taken together* the studies would seen to indicate that soae pro- 
groaned aaterials can be aore effective than non-prograaaed aaterlals in 
holding pupil attention and that pupils do not necessarily becoae less atten- 
tive as they continue to use prograas over a period of tiae. 

% 

Studies of Pupil Attitude 

Further studies of pupil reaction to the use of prograaaed aater la l s 
were carried out by obtaining aeosures of pupil attitude. In these studies 
•ensures were obtained both of (1) pupil attitude toward the use of pro- 
groaned aaterlals and (2) pupil attitude toward the subject being studied. 
With the first aeasure it was possible to note pupil changes in attitude 
over an extended period during which they were studying froa progroas. With 



Abase plans* described briefly in this chapter* are explained in 
aore detail elsewhere in this report. 

^The studies reported in this section plus additional studies of 
pupil attitude are presented in detail in Ferderber* Joseph I. Changes in 
Selected Student Attitudes and Personality Measures and Their telatibnship 
to Achleveaent* Intelligence* and late When Using Prograaaed Instruction* 
(Unpublished Id.D dissertation* University of Pittsburgh* 1963). 
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the second Mciurc it was possible to colors attitudes and changes in at- 
titude of pupils studying Iron program and pupils studying from non-pro* 
grannsd materials. 

To obtain tbssa naasuras of attitude 9 two saparata Likert-type at* 
tltuda sealas of 12 itasw aach vara developed* Ona measured attltuda toward 
tha usa of progrannad natarials. The otbar aaasurad attltuda toward tha 
subject. Prior to using tbasa Instruasnts tbs raliablllty of aaeb was da- 
tarninad through tba usa of tba split-half procadura and tha Spaaraan-Brown 
foraula. Bata froa tba raliablllty studlas aay ba suanarlsad as follows: 



Scale 


II 


Bsllablllty Coefficient 


Attitude toward Progressed 


264 


•950 


Attltuda toward Subject 


168 


.950 



Chanaas in Attltuda Toward tha Baa of Proa raaaad Matarlals 

▲ study of what bappans to student attltuda toward tba usa of pro* 
graaaad natarials as pupils usa such asterials over tba course of a saaastar 
was aada by aaasuring attitudes of pupils in four seventh-grade general 
science classes using a general acianca program.* All pupils involved vara . 
asked to respond to tha attltuda scale at (1) tba and of tha first veek 9 
(2) tha and of tha second week, (3) tha and of the fourth week* and 
(4) tha and of tha saaastar. A suanary of these results and an analysis of 
tha significance of tha differences found is presented in tables 2.7 and 2.8. 

Proa this suaaary and analysis it can ba seen that with this pro- 
gran used under these conditions there was a definite decrease in favors* 
bleness of attltuda toward tha usa of progressed natarials. Also» there was 



These classes worded in general science progressed texts for ona 
saaastar and studied tha following topics: aeasureasnt, meteorology, as* 
tronoay, sound » light 9 electricity 9 and conaunleatlons. These ware topics 
usually included in tha existing seventh-grade curriculum. 
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Table 2.7 

Mean Attitude-Scale (Attitude Toward Ota of Programed Materials) Scores 
Obtained at Given Sessions for Four Seventh-Grade Cleeses Using a 

General Science Progran 




Mean Attitude Scale Score for Class 



Class End of End of End of End of All 

***k 2nd week 4th week Senester Testa 



A (N-31) 


43.97 


39.94 


38.63 


30.65 


38.80 


B (N-32) 


48.38 


46.16 


43.13 


30.06 


41.93 


C (N-32) 


29.00 


29.50 


25.69 


24.13 


27.08 


D (N-31) 


43.33 


39.36 


33.94 


27.38 


36.11 


All Claasea 


41.73 


38.74 


35.33 


28.11 


35.98 



Table 2.8 



Sumary of Analysis of Variance of Attitude-Scale 
Four Seventh-Grade Classes Using General Science 



for 



Source 


Sun of Squares 


df 


Mean Square F 


Sessions 


13,670 


3 


4,556.67 22.26** 

•• ''f ; ^ t “■ * “ .... 


Classes- 


16,504 


3 


5,301.33 26.88**. 


Kesldual 


• - ^ 1,844 


9 


i 204.67 


Total 


32,018 

' 


15 

f , 


i , 






at •• 

W ;; . K 
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a significant difference pmong these four classes in their attitudes toward 
the use of such materials • 

The Correlation of Attitude with Ae M tmtnt and Intellisanco 

The neasures of attitude toward the use of programmed materials were 
studied further by determining the correlation of attitude with intelligence 
and with various measures of achievement* These correlations are presented 
in Table 2.9, The only thing to note here is that none of these correla- 
tions are significant at the .01 level. This indicates that a student's 
attitude toward the use of programmed materials is not related to his level 
of intelligence. Also, his attitude does not appear to be a factor in de- 
termining how well he learns from a program. 

Table 2.9 

Correlation of Attitude Toward Use of Programmed Materials 
(Measured at End of Semester) With Intelligence end 
Various Measures of Achievement 



Test 


Correlation with Attitude toward 
Program (hud of Semester) 


Otis 1. Q. 


•02S 


Coop. Science Test 




Pre-testing ‘ 
Post-testing 


•102 

•210 


Tests for Units of the Program 




Astronomy^ 

Sounds..; 

Light' 

Electricity 

Communication 


.091 

.223 

•202 

•1S2 

.226 

.159 



r of .229 needed for significance at .01 level 
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Chances la Attitude Toward the Subject klat Studio 

SeyrotHride Scltact t The relationship of the ust of progr earned 
ntttriali to a student's attitude toward th« subject ha is studying was an- 
other aspect of the investigation of attitudes* This relationship was first 
studied with the students in the four seventh-grade classes studying the 
general science prograa. In this case the attitude measures were also ob- 
tained for seventh-grade students using non-prograamed Materials to study 
general science* All students were given the special 12-statement 9 Likert- 
type attitude scale at the beginning of the semester and again at the end 
of the seaester* 

The suaaary of these measures for the four classes studying froa the 
prograa and the results froa the analysis of variance are presented in Tables 
2*10 and 2*11* Proa the suaaary it can be seen that there was a significant 
decrease in favorableness of attitude toward the subject during the seaester 
of study* This decrease was present in the case of all four classes Involved 
in the study* 

The change in attitude toward the subject was also aeasured for a 
group of 63 students studying this saae subject 9 general science 9 with non- 
prograaaed materials. These results are presented in Table 2*12* Here the 
decrease in favorableness of attitude was also present but was not statisti- 
cally significant* It should be pointed out that the design of this analy- 
sis did not perait a test of the significance of the difference in chance 
in attitude between students studying froa a prograa and those using non- 
prograaaed materials. 

The measures of attitude toward the subject were investigated fur- 
ther by determining the correlation of attitude at the end of the seaester 
with IQ and with achievement* These correlations are shown in Table 2*13* 

It can be seen that while none of these correlations are large 9 most of them 
are significant at the *01 level. 
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Table 2*10 

(Attitude toward Subject) Scoraa Obtained 




Claes 


Mean Attitude-Scale Score for Claaa 


Start of Sen. 


Bad of Sen. 


Maan 


A («-31) 


47.36 


36.00 


41.68 


B (H-32) 


49.16 


39.69 


44.43 


C (H-32) 


37.61 


24.60 


31.21 


D (N-31) 


41.10 


38.94 


40.02 


All CImmm (N-126) 


43.85 


34.76 


39.33 



Table 2.11 

Sunaary of Analyele of Variance of Attitude-Scale (Attitude touerd Subject) 
Scoraa for Pour Semth-Gradi Claaaea Oaing the General Science Frograa 



Source 


Sun of Squarea 


df 


MOan Square 


F 


Seesiona 


5,158 


1 


5,158 i- 1 ' 


13.54* 


Claaaea 


' ' 6,212 


3 


2,071 


\. ",'5.4l; ' 




1,143 


3 


381 


■ ■■; - ' 


Total 


12,313. ■ 

■ ■ . . V - •- •, /■ - . '••••• . ' ■ 




_ ' * r. 
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Table 2.12 

Mean Attitude-Scale (Attitude toward Subject) Scores Obtained at 
Beginning and Endof Seawater for 63 Seventh-Grade 
Students Studying General Science with Kon-Prograaaed Materials 



Mean Attitude Scores 


Difference 


j * _ 

t-value 


Start of Sea* 


Bud ©£ §m • 


Between Means 


for Difference 


48. 51 


46.25 


2*26 


1.90* ’ 



*Not significant at .05 level with 2-tail test 



Table 2.13 

Correlation of Attitude Toward tbe Subject Being Studied (Measured at End of 
Seaester) With Intelligence and Various Measures of Achieveaent 



Test 


Correlation with Attitude toward Subject 


■ , : lor Prog* Etudes 


its .For Kon-Prrg. Students 


Otis I* Q. 


.121 


.323** 


Coop* Science Test 






Pre-testing 


•174 


.349** 


Fost-testing 


.334** 


.336** 


Tests for ..Unite of the Progr 
Meteorology 


an 

•202 


v : - - ; *c- .. ;■ . : ■ 


Astronoay ' '■! 


.323** 

- ease*- 


/find Ai SaiaS a 


bight §|= 3 - = •_ : y^ ’ 

W 1 gags' eeJ £ S»m 


UiM 


v«mnc cfici 
■ not given) 


. Coaaunieation 


. ’<seo— — 

y 'i-- 1 . 317*1^; 


■ ' ■ .. ■ 4 £4^,; 


-•* " • ’ ■ s ■’ - '> 1 '■ ;• "... . *'-• ' ' > M.J-V i.V-A*; 






**Signlf leant at *01 level 
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Froiritd Alttbri * Using the mm seals for Measuring attitude 
toward a subject that was used in the study of attitudes of seventh-grade 
science students , Measures were obtained at the beginning of the school 
year and at the end of the school year for two classes of ninth graders 
using an algebra program. This was the algebra program, described More 
fully in other sections of this report, developed to teach a rather tradi- 
tional algebra content. 

4 sunnary of the attitude Measures obtained for these classes and 
the results frou the analysis of variance are presented in Tables 2.14 and 

2.15. 

Here it can be seen that there was a significant decrease in favora- 
bleness of attitude toward the subject frou the beginning to the end of the 
year. It is also interesting to note that the change in attitude was es- 
sentially the sane for the two classes. 

Proaramw *' 1 Mathematics . Change in attitude toward the sub- 

ject during the course of a school year was also investigated with a class 
of 36 students using a Modem Mathematics program. This program has been 
described in a previous section of this report and is one designed to teach 
Much of the "aodem mathematics" content now being recommended for use in 
a beginning high school level course. 

k suaaary of the attitude measures obtained at the beginning and 
end of the year for this class and the results of the test of the signifi- 
cance of the change in mean measures are presented in Table 2.16. 

With the class and this program, the results were different from 
what they were in the ease where pupils were studying the algebra program. 
With the modem mathematics program, there was essentially no change in 
student attitude toward the subject. 

Mon-Proarammed Alaebra . To obtain some idea of what happens to 
pupil attitude toward a subject when the subject is being studied without 
the use of programmed materials, the same scale used in the above studies 
was administered at the beginning and the end of the year to 60 students 
studying with ninth-grade algebra from a rather conventional textbook. The 
content covered in this course was essentially the same as that covered 
with the programmed algebra course. 
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Table 2.14 

Mean Attitude-Scale (Attitude toward Subject) Scores Obtained at Beginning 
and End of Tear for Classes Using the Algebra Program 



Class ' 




Mean Attitude— Scale Score for Class 






Beg. of 
Year 


End of 
Year 


Mean 


J (N-64) 




40.09 


28*88 


34.39 


K (N“67) 




40.02 


28.64 


34.33 


loth Classes (N«131) 


40.05 


28.76 


34.40 




t 


. Table-. 2, 


.15 




Sunnary of Analysis of Variance of Attitude-Scale (Attitude toward Subject) 
Scores for Ninth-Grade Classes Using the Algebra Progran 


Source 


Sun of Squares 


df 


Mean Square 


F 


Sessions 


8,401 . 


1 


8,401 


70.01** 


Classes 


42 


1. 


42 


.35 


Residual 


120 


1 


120 




Total 


. 8,363 ..... 


3 







**Signif leant at .01 level 
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Table 2*16 

Mean ittitudc*8calc (Attitude toward Subject) Scores Obtained at Beginning 
and End of Tsar for 36 Ninth-Grade Students Using the Modern Mathematics 

Program 



Mean Attitude Scores 


Difference 


t-value 

for Difference 


Beg. of Year 


End of Year 


Between Means 


32. 7S 


37.44 


0.16 


•08* 



*Not significant at .05 level 



A summary of the attitude measures for these algebra students study- 
ing with non-prograamed materials Is presented In Table 2.17. 



Table 2*17 

Mean Attitude-Scale (Attitude toward Subject) Scores Obtained at Beginning 
and End of Tear for 60 Ninth-Grade Students Studying Algebra With Non- 

Prograamed Materials 



Mean Attitude Scores 


Difference 
Between Means 


t-value 

for Difference 


Beg. of Year 


End. of Year 


42.48 


39.07 


3.41 


2.26* 



*Slgnlf leant at .05 level 



Here again there Is a significant decrease in favorableness of at- 
titude during the course of the year. While this decrease Is not as large 
In abeolute value as hat shown by students using the algebra program, it 
Is a difference which Is significant at the .05 level. 






Correlation of Attitude Hy ^gi with Achltfant and Inflllmica . 
The Matures of attitude toward the subject for the ninth-grade asthenstics 
students were investigated further by deternlning the correlation of the 
neesures obtained at the end of the year with selected achievement measures , 
with intelligence » and with rate of progress through a program. These cor- 
relations ere suaaarised in Table 2.18. It will be noted that most of the 
correlation coefficients ere not significantly different froa sero and that 
even those that are significant are quite snail* 

Table 2*18 

Correlations of Attitude Toward the Subject Being Studied (Measured at Bnd of 
Tear) with Intelligence » Rate, and Various Measures of Achlevenent for 
Selected Ninth-Grade Students Studying Algebra end Modern Matheaatlcs 



Test 


Correlation with Attitude Toward Subject 


TMUC 

(N-131) 


SKA 

(H-36) 


Non-Prograa 
Students (N«60) 


Otis I. Q. 


•069 


•065 


•050 


Modern Math 


• 107 


.153 


• 228 


Coop* Algebra Test 


• 004 


.233 


.475** 


Rate 








9 weeks 


-.054 


-.009 




18 weeks 


•076 


-.132 


(Other neesures 


27 weeks 


-.017 


.116 


not applicable) 


38 weeks 


-.010 


.059 




Frame Rate (SRA only) 




-.094 




Unit Tests 








First test 


•068 


.041 




Last test 


.272 


-.178 





**Signlf leant at *01 level 
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Discuss ion: Studies of Pupil Attitude 

The itudlis of pupil attitude presented in this report provide cer- 
tain descriptive data concerning what happens to the attitudes of students 
as they rtudy certain prograaned materials in regular school situations* 

The results would seen to offer sons suggestions for things that should he 
of concern to persons or agencies developing progress and for teachers who 
are using such aaterlals* They also suggest several hypot,. .as for further 
study* 

In suanarlslng the data on changes in attitude toward the use of 
prograaned aaterlals it would have to he said that in the situations in- 
vestigated in this study there was a rather consistent decrease in favora- 
hleness of attitude as prograas were used over a year's tine* Of course* 
a weakness of the present study was that no coaparahle measure of change 
in attitude toward other Methods of study was obtained* That ls 9 it night 
he that if students were questioned at periodic intervals over the course 
of a school year concerning their liking for any particular aethod of study 
that the favorableness of their attitude would steadily decrease* 

The investigation of changes in attitude toward the subject being 
studied revealed no consistent pattern in such changes* That ls 9 the stu- 
dents studying the prograaned algebra showed a decrease in favorableness 
of attitude 9 those studying prograaned aodern natheaatlcs shoved no change 9 
and those studying algebra with non-prograaaed aaterlals shoved a decrease 
in favorableness* The interesting thing to note here was that in the two 
eases where decreases were found 9 the saae subject* algebra* was Involved 
while in the case where Interest was Maintained* a different and relatively 
new subject-natter content was bain 0 ’, studied* This suggests the very rea- 
sonable hypothesis that the content being studied nay be a aore Important 
determiner of attitude toward a subject than is node of presentation* 
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Studies of the Correlation of Achievement and Aptitude^ 

The Introduction of programed naterlals Into the classroom on any 
broad scale will undoubtedly require a re-examination of the concept of 
"aptitude* 1 and the relationship of aptitude and achievement. For example. 

It may be that the typical positive correlation between Intelligence and 
achievement In academic subjects Is largely a function of variations In the 
speed with which pupils can master material. Might not this correlation be 
expected to be reduced when pupils are permitted to progress at their own 
rates and rhere each student masters the material at each step before pro- 
ceeding to the next, as should be the case when programmed materials are 
used? In this latter situation all students should attain a high degree of 
mastery and scores on tests designed to cover a given unit should vary lit- 
tle from low to high intelligence levels. On the other hand, if programed 
material is used and each pupil is permitted to progress at his own pace, 
these variations In amount of material covered could result In an even 
greater variation of scores on comprehensive measures such as standardised 
achievement tests. This could, conceivably, result In a higher correlation 
between aptitude and achievement. It is problems of this type that are the 
general concern of the studies outlined In this section. 

Related Research 

The analysis of preliminary data that have been gathered as a part 
of the present over-all study indicate that, in the ease of junior high 
school students studying general science through the use of a program as com- 
pared with students studying general science with non-prograaned materials, 
there is a greater correlation between intelligence and achievement for the 
latter group than for the former. This seems to be in agreement with the 



5 

The studies reported in this section plus additional studies involv- 
ing the correlation of achievement and aptitude are presented In detail in 
McCormick, James H. Differences in the Relationship Bstween Achievement and 
Selected Measures of Aptitude under Programmed and Mon-Programmed Instruction 
(Unpublished Rd.D. dissertation. University of Pittsburgh, 1963). 
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findings of Porter (1959) when spelling was the subject being studied end 
also with the finding of Meyer (I960) who wss studying the results of the 
use of s vocabulary program. 

Correlation of Aptitude and Achievement for Fourth-Grade Students Using 
Spelling and Multiplication and Division Programs 

The correlation between intelligence and aptitude was studied in 
the case of fourth-grade students using the spelling program and the mul- 
tiplication and division program. In both cases the correlations obtained 
with students using a program were compared with those obtained with a simi- 
lar group using non-programmed materials. 

Two hypotheses were of interest here. One was that since using pro- 
grammed materials should permit all students to master a subject, the cor- 
relation of intelligence and achievement should be smaller when programmed 
materials are used. The second hypothesis was that when pupils study from 
a program the correlation of intelligence with achievement as measured by a 
standardised test should be higher than the correlation with a test specifi- 
cally developed to measure acquisition of the material taught by the program. 
This hypothesis is derived from the idea that a standardised test will meas- 
ure more general abilities, some involving transfer of learning, and that 
intelligence will be a factor in this ability to transfer or generalise. 

The studies described here, due to limitations in sampling as well 
as other factors, cannot be considered as providing any formal test of these 
hypotheses. They are intended rather to provide objective evidence which 
should be helpful in planning a more formal testing of hypotheses. 

Tables 2.19 and 2.20 summarise the correlations obtained in the two 
investigations carried out to obtain information on these relationships. 

In Table 2.19 the evidence concerning the difference between program 
and non-program groups in the correlation between intelligence and achieve- 
ment is inconclusive. As can be seen, with the program test the correlation 
is higher for the non-program group, with the Iowa Test the correlations are 
essentially equal, and with the Stanford Test the program group shows the 
higher correlation. There is no clear evidence here to suggest that the use 
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of programmed notorial* raaults in a Invar correlation betveen aptitude and 
achievement. However, there ia evidence to auggaat that with pupil* study- 
ing fron a program tha corralation of intalliganca and aehiavaaant vill ha 
lovar when a special program tost ia used aa a measure of achievement than 
vhen a standardised test is used for the latter measure. Also, it aeons rea- 
sonable to attribute the higher corralation of IQ vith tha Program test of 
the non-program group to tha fact that tha brighter students are more likely 
to have learned vorde other than those specifically taught. 

In Table 2.20 thara is sons indication that tha corralation betveen 
intelligence and achievement is greater for pupils studying fron non-pro- 
graaned materials than it is for pupils using a program. There is also evi- 
dence to suggest that with pupil* studying from a program the correlation 
betveen intelligence and achievement will be greater vhen a standardised 
test is used to measure achievement. 

The Correlation of Intelllnence and Achievement for Seventh-Grade General 
Science Students 

A further investigation of the correlation betveen intelligence and 
achievement vhen pupils study from progressed materials as compared vith the 
situation vhere pupils study from non-progranmed materials vas made by study- 
ing this relationship for the seventh-grade general science students. Here 
correlations determined for the 126 students studying the general sci- 
ence without the use of programmed materials. 

In this investigation the Otis teat vas used to measure intelligence 
and the Cooperative General Science test was used to measure achievement. 

Also used as achievement measures for the students using the program were 
six aeparate teats developed to measure achievement on each of aix units of 
the program and a special ^criterion teat 11 developed to measure over-all 
achievement on the total program. The inclusion of these program tests per- 
mitted a comparison of the correlation of intelligence with such tests de- 
signed specifically to meaaure the objectives of a program and the corre- 
lation of intelligence vith a more general measure of achi e vem en t, the 
standardised test. The correlations obtained are reported in Table 2.21. 
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Table 2.19 

Correlation of Otis IQ with Siltettd Measures of Achlevensnt for Fourth-Grade 
Pupils Using the Spelling Program and for a Comparable Group of •• ,, 

Fourth Graders Studying Spelling with Non-Progranned Materials 



Correlation of Otis IQ With 



Group 


Progran 


Iowa Test: 


Stanford Test: 




Test 


Spelling Score Spelling Score 


Progran Group (N*169) 


.232 


•396 


.414 


Non-Prog. Group (N«38) 


.479 


.402 


.121 



Table 2.20 

Correlation of Otis IQ with Selected Measures of Achievement for Fourth-Grade 
Pupils Using the Multiplication and Division Progran and for a Conparable 
Group Studying Multiplication and Division with Non-Frograaned Materials 







Correlation of Otis IQ With 


Group 


Progran Stanford 

Test Arith. Av. 



Progran Group (N*173) 


•202 


•314 


Non-Prog. Group (N*59) 


•262 


.440 
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Table 2.21 

Correlation* of Otla IQ with Various Measures of Achievement for Sevanth-Grade 
Student* Studying General Science free Programed and Mon-Programmed Kateriala 



^ ■ ■ " . . ; 

\ Teat* Correlation with Otie IQ 



For student* using program (N»126) 



Coop* General Science Test ,532 
Program Criterion .555 
Program Unit Tests 

Meteorology ,595 
Astronomy ,522 
Sound ,470 
Light ,415 
Electricity ,530 
Com mun ication ,574 

For students not using program (N«63) 

Coop* , General Science Test ,594 



A comparison of the correlations between Otis IQ and Coop* test score 
for the two groups (.532 and *594) indicates that the difference between 
them is of no practical significance* The earns can be said for the differ-* 
•nee for the program group between the correlation of Otia IQ with achieve- 
ment on the Coop* teat and with achievement on the criterion test (*532 and 
•566) • 

It will be noted that the data obtained for seventh-grade acience 
students concerning the relationships of intelligence and achievement does 

■ f 

not show the same differences found in the previously presented data on 
fourth-grade students studying spelling or arithmetic* 
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Discussions The Correlation of Achievement and Aptitude 

Till* section lies presented date with respect to the hypotheses 
(1) that the correlation between IQ and achievement will be lower when stu- 
dents study from programmed materials than when they study from non-pro- 
grammed materials and (2) that the correlation between IQ and achievement 
will be greater when a standardised achievement test Is used than when the 
achievement test is one specifically developed for the program of study. In 
only one of the three studies was the first hypothesis supported , but two of 
the three studies provided data that supported the second hypothesis. These 
results, then, provide no conclusive evidence concerning the effect of pro- 
grammed Instruction on the relationship between IQ and achievement. The ef- 
fect of different methods of study on the relationship of aptitude and 
achievement Is one which should continue to be of concern to educators. 
However, the results do provide some substantiation for the Idea that IQ Is 
not as much a determiner of how well a person can master the specific con- 
tent In which he is given Instruction as it Is a determiner of how well he 
can generalise from what he has been taught to a comprehension of related 
ideas. This finding, if true, would have Important Implications for the 
methods of Instruction that should be used with students at different abil- 
ity levels. 
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Sumary 

- This chapter has presented data concerning the inpact of programed 
Instruction on a variety of student variables. Three separate studies in- 
volving a structured observation of the attentiveness of pupils under pro- 
granned and non-programed instruction provided evidence that pupils were 

i ■ . 

significantly aore attentive while studying from program. Also, there was 
no general tendency for this attentiveness to decrease significantly over 
tine. However, in separate studies of pupil attitude toward the use of 
programed instruction there was a tendency for the pupils 9 expressed atti- 
tude to decrease in favorableness as the progress were used over an ex- 
tneded period of tine. Unfortunately, the studies did not provide for 
data on coaparable changes in attitude when pupils used other asthods of 
study. Three investigations Involving changes in attitude toward the sub- 
ject being studied resulted in data that suggest that the content involved 
has aore influence on attitude than does the aethod of presentation. 

Studies of the correlation of IQ and achleveaent indicate that the use of 
programmed Instruction has little effect on this relationship but that 
this correlation is slightly higher when achleveaent is aeasured by a stan- 
dardized test rather than a test developed specifically for the unit of 
study. 



i 
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CHAPTER 3 

PROGRAMMED INSTRUCTION: SOME UNANTICIPATED CONSEQUENCES 

Richard O* Carlson 
Introduction 

Any change is made in anticipation of apaeifiad results. In this 
eaaa of tha introduction of programed instruction, the anticipated results 
cantered on facilitating the learning process in children* The bulk of 
this report deals with an evaluation of the extent to which progressed in- 
struction fulfills these anticipated results* 

Just as change has anticipated consequences, it has unanticipated 
consequences* The results of the introduction of progressed instruction 
(or any other innovation) spill over that which was anticipated or intended* 
It is the purpose of this chapter to report on selected aspects of the 
spillover, or the unanticipated consequences of the use of progressed in- 
struction* 

It is possible to get bogged down on the question of what was in- 
tended and what was not* Part of the difficulty is chat the acceptors of 
a new innovation tend to assert that all results were at least party sus- 
pected in the beginning* Therefore, they are frequently an unsellable 
source on the natter of what was intended and what was not* Further, no 
useful purpose is served here by attesptlng to draw a fine line between 
anticipated and unanticipated consequences* The perspective taken in this 
chapter on the question of what was intended and what was not is arbitrary, 
and is that all consequences not directly linked to the learning process 
were unintended* 

The reporting of unanticipated consequences involves another poten- 
tial problen, whiet& is the assessment in terns of their good or bad effects* 
Making this assessment calls for- data well beyond that reported here and, 
in addition, calls into play an array of personal values that can and do 



^Mow at the Center for the advanced study of Educational Adminis- 
tration at the University of Oregon* 
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vary greatly. Therefore* no Judgments will be attempted here. Neverthe- 
less* this is an extremely relevant question that must be answered by e 
school district as It evaluates Its work. 

Having made It clear that the intention here Is neither to prove 
that certain results were not anticipated nor to assert that these unintended 
consequences seriously detract or enhance the use of programmed instruction* 
the task is to simply report some findings that Illustrate the range of im- 
pact of programmed Instruction. 

The Method of Evaluation 

This impact will be reported as seen through the eyes of the parti- 
cipants who were Involved in the programmed instruction experiment. The 
findings reported here are based on interviews conducted in several stages 
with building principals* teachers* and central office personnel who had 
some direct responsibility for programmed instruction. At first the inter- 
views were designed simply to determine the range of changes that thesa 
people saw in the alteration of their functions through the introduction 
of programmed instruction. In most cases* programmed instruction had been 
in use for a year and a half at the beginning of the Interviews so that 
the informants had some depth of experience to draw upon. As the inter- 
viewing progressed* the question changed in order to obtain specific infor- 
mation. The areas of impact of programmed instruction reported here can 
be divided roughly into three categories: (1) supervision* (2) rates of 

individual achievement* and (3) the teachers' need to perform. 
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Classroom Observation end Teacher Supervision 

The building principals in Baldwln-Whitehall, like most principals, 
are responsible for observing and judging the work of the teachers in their 
building* This responsibility calls for the principal to subnit a report 
to the superintendent on the teaching performance of each teacher, a task 
for which the principal is by no Mans unprepared* Schools of education 
offer or require courses in supervision and classroom observation, creden- 
tial requirements Include such courses, and many books treat the subject* 
'Further, principals tend to see classroom observation as an important area, 
for they often complain that their time for it is eroded away by other less 
crucial duties* 

In spite of all of this, programed instruction seems to have under- 
mined the classroom observation routine or maybe even forced it to a halt* 
Some rather curious things happen when principals observe teachers who are 
using programmed Instruction— curious in the sense that what takes place in 
no way resembles the practices they use in observing the regular classroom 
situation* Two forms of classroom observation of programmed instruction 
seem to take shape* One form simply Involves ignoring or abandoning the 
observation of the teachers using programmed instruction* Approximately 
one-third of the principals employed this form* Their justification for 
so doing was that programmed Instruction was experimental so they wanted 
to give the teacher a free hand* After stating their position they were 
ready to point out the difficulties involved in thinking about how to super- 
vise teachers using programmed Instruction. These difficulties are made 
apparent in the next section* It seemed that those principals who ignored 
the observation responsibility did not know how to proceed when new in- 
structional methods were used and so they abandoned this responsibility 
and fell upon the notion of experimental conditions as a rationalisation* 
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That the classroom observation practices used in regard to pro- 
grammed instruction deviated from the formal 1 ' or usual routine was docu- 
mented only by responses of teachers (both those Involved with programmed 
Instruction and those not Involved) and principals* 
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As can be seen, this interpret at Ion nay be conjecture, but it is given sons 
support by the other form of classroom observation enployed by the remainder 
of the principals* 

The principals that did perform the supervisory function with teachers 
using programmed instruction tended to throw aside the procedures they had 
learned, developed, and used in observing regular classroom teaching* In- 
stead, some of the principals asked the students to tell them how the teacher 
was doing, others were in the habit of looking in only to see if the teacher 
was sitting at her desk or passing among the pupils (sitting meant that in- 
dividual help was not being given and moving around the room meant the op- 
posite) , and still other principals who observed teachers using programmed 
instruction made judgments about the teacher's ability by noting her skill 
in storing the instructional material and keeping the machines and programs 
in good order* Aside from the question of the adequacy of these forms of 
classroom observation. It is clear that programmed instruction creates a 
classroom situation with which principals are not prepared to deal* The 
principal's training in supervision is built around the standard classroom 
setting in which the teacher is presenting and discussing material with 
students, setting their tasks, and directing their group activities* 

As far as classroom observation is. concerned, programmed instruc- 
tion is characterised by two features which throw the principal and his 
supervisor tactics off stride. One has to do with the teaching goals* A 
general strategy of supervision is to require teachers to submit their dally 
lesson plans to the principal for evaluation on a number of criteria such 
as adequacy of goals, and variety of activities* The plans also give the 
principal a means of judging the activities in any class he might observe 
for he has the instructional objectives available* As can be seen this 
stratagem is rendered irrelevant with programmed instruction because there 
are no dally lesson plans to be submitted* In fact the program sets the 
overall goals, and many of the daily activities were controlled by the pace 
of the class or individual students and the design of ... the study which the 
teacher was required to follow as outlined in her manual* 
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The second characteristic feature of programed Instruction which 
undermines the standard practice of classroom observation is that it breaks 
Into a mrre collection of individuals that which is a group in the regular 
classroom setting. In programmed instruction the teacher deals with the 
students on an individual basis whereas in the regular classroom the teacher 
deals mainly with the students as a group. Current supervisory tactics are 
geared to the group setting. An examination of any observation fora or text- 
book will make this dear. So, to the extent that the group situation is 
absent, the principal finds that he cannot observe many of the activities 
that he has considered to be central to a good learning situation. 

Without dally lesson plans and without seeing the teacher work with 
a group, the principal seems to be thrown off stride and either Ignores the 
classroom observation function or reaorts to asking students to judge the 
teachers or merely; notes her clerical-like abilities. It seems clear that 
new supervisory procedures must be developed. 

As a sidelight on the natter of supervision, it seems that [.rogrammed 
instruction will be an element that will interfere with the opportunities 
that principals take to visit classrooms. Most principals reported that 
they themselves went into the classroom to substitute for an absent teacher 
if she was involved in programmed instruction. This was not the routine 
way of providing for substitutes, and principals did not serve as substi- 
tutes for teachers not Involved in programed instruction. In part this 
suggests that principals see programmed instruction as the most important 
activity in the school in the sense that it cannot be entrusted to anyone 
less qualified than the principal. Also, it suggests that school districts 
will need to develop specialists who can work with programmed instructional 
classes among the substitutes. ** 
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Rates of Individual Achievement 

An important anticipated consequence of programmed Instruction is 
that all pupils will be able to learn at their own rates* However, two ad- 
ditional notations must be made* On the one hand there are forces operating 
to minimise the differences in individual rates of achievement, and on the 
other there are school-wide consequences when learning proceeds at vastly 
different rates* 

In a dramatic way programmed Instruction forces a school to stand 
face to face with the fact that students learn at widely varying rates* it 
is true that some of the most shopworn cliches such as "we teach children, 
not subjects" and "start the learning experience where the child is" reflect 
a concern for individual differences and suggest that educators are most 
anxious to tailor learning needs and speeds to individuals* When faced with 
programmed instruction, which permits students to work at their own rates, 
however, the hollowness of the cliches is exposed, and a host of practices 
emerge in an effort to keep students working at similar rates* 

Some of these practices could be classified by the cynic as sabo- 
tage* The clearest example of this is that as a program progressed* the 
levels of individual achievement and the range in number of frames com- 
pleted varied widely, and, as a means of "correcting" this, several teachers 
were discovered either consciously or unconsciously to be pacing students* 
That is, teachers were actually restricting the output of the students pro- 
ceeding at the fastest rates* The logic of restricting output of fast stu- 
dents is tidy and makes good sense from at least one viewpoint* Explaining 
the same troublesome point to five, students who hav encountered it at the 
same time is less time consuming than explaining the same troublesome point 
to the same five students as they encounter it at different points in time* 
For the teacher who complains that there is never enough time this appears 
to be most efficient* In fact, insisting that all students move at the 
same rate, which la attempted in many classrooms, can be supported by the 
sane logic* 

But pacing the work of fast students by teachers is not the only 
way in which the schools have attempted to "correct" the move toward total 
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Individualized Instruction brought on by programmed Instruction* A prac- 
tice sanctioned by the administration sets to work on the other end of the 
continuum, the slow student* In the general science program it was deemed 
wise, in the face of ever-growing differences in accomplishment, to allow 
some students to work on their programs at home* The original decision of 
restricting the use of programs to the regular class period was reversed 
only for slow students; average and fast students continued to have access 
to the programs only during class time* It could be argued that this pro- 
cedure of allowing only slow students access to programs outside of class 
time is a clear example of the school's attempt to individualize instruc- 
tion* However, average and fast students were not allowed extra-class ac- 
cess to the programs and the procedure had the net effect of minimizing 
the range of student progress* This is one example of several attempts to 
"correct" almost total individualized instruction which seems possible with 
programmed instruction* 

In addition to restricting the rate of progress of fast students ^ 
and allowing slow students more time with the programs, another practice 
emerged which can also be seen as a "correctional" factor* "Enrichment 
materials" seem to be used in an effort td keep the range of progress 
through a program at a minimum* Such material developed around some of 
the programs was used most extensively with the students making rapid prog- 
ress through a program; those making slow progress encountered it less 
often* In a sense, slow students had the task of working through the pro- 
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gram, fast students had this responsibility plus that of some level of 
mastery of the enrichment materials* This mechanism greatly increases 
the possibility that the level of achievement on the program by the slow 
student will be equal to the level of achievement on the program by the 
fast learner in the same number of clase days. ThL* is not to say that 
the use of enrichment material is undesirable, but simply that the use of 
enrichment material as here indicated tends to bring about a condition of 
minimum spread of rates of progress through the program* 

The point being made here can be summarised as follows* Programmed 
instruction makes it possible for each student to proceed at his own rate* 
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In this sense* it allows for individual differences* Programed instruc- 
tion* possibly sore than any other innovation* presents the teacher and 
the school with the opportunity of achieving individualised instruction* 
But when faced with this opportunity* in this single case* Mechanises 
emerged— such as restricting the pace of fast learners and asking tine to 
work on program more available to slower students— which tended to Mini- 
mise the spread of progress through the program by students of varying 
ability* Therefore* it can be said that one of the consequences of the 
acceptance of prograaaed instruction is that it brings the educator face 
to face with a situation in which individual differences can be mt; but 
the educators in the case reported here instituted practices which reduced 
the range of differences in achievement that night otherwise have been 
evident* All of this simply suggests that schools as they are now struc- 
tured are either unable or unwilling to accept something near total indi- 
vidualized instruction. 

The second consequence of a program where students can move at 
widely varying rates is simple and clear: scheduling problems become more 

complex. This can be seen when the question is raised as to what the stu- 
dents do who either fail to complete the program during the allotted tins 
or finish it far earlier* Given the problem of schools (as«they are now 

a 

constituted) in dealing with such occurence* it seem reasonable to assume 
that this is one of the possible pressures which lead to the institution 
of the above-mentioned "corrective 11 actions. 

A variety of solutions were developed to "take care of" students 
who either finished too early or did not finish* Most of them were focused 
on the latter case where the student could not complete the work required. 
In part* this occurred because of the assumption that the able student can 
more easily be occupied in the learning process* One procedure was to 
permit students to take two semesters to complete a program designed for 
one semester* Another practice was to enroll the student in a summer ses- 
sion to enable him to complete a program he did not finish in the allotted 
time* As can be seen* the procedure of letting slow students take the pro- 
gram horn was in part an attempt to avoid the necessity of either of these 
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alternatives • One of the very Interesting solutions consisted of holding 
students who had not finished souse weeks later , and then Inserting then 
In an ongoing speech or music class which they were scheduled to begin In 
the winter semester. This seems Interesting to the extent that It sug- 
gests a value priority held by educators for the various subjects that 
schools offer. In no way did this solution Increase the popularity of pro- 
grammed instruction among speech and music teachers. 

The Teacher's Need to Perform 

The experience of the Baldwin-Whltehall school district with pro- 
grammed instruction seems to indicate that teachers have a somewhat com- 
pelling need to perform. "Perform" here means (a) capture and hold the 
attention of a number of students , and (b) serve continuously as the 
mediator between the student and the information. This Is what teachers 
seem to define as teaching. All other acts seem to be assessed as sup- 
porting acts, not teaching. Programmed Instruction does not give the 
teachers as much opportunity to perform as they appairently desire; It 
does not give them sufficient opportunity to teach. In their eyes, because 
teaching means performing, using programmed instruction Is not teaching. 

All of this can be Inferred from conversations with teachers and 
seen in what happened with some of the programs. The mathematics program 
serves as a good example • At the beginning of the experiment with pro- 
grammed instruction, students of mathematics met in the usual number with 
one teacher and proceeded to move through the program ind ividual ly at 
their own rates. The second year's use of the mathematics program brought 
the following innovations two groups of students were scheduled to meet 
simultaneously with two instructors and, under this arrangement, students 
worked on the program part of the time and met with a group of students who 
had reached approximately the same place in the program and an Instructor 
using regular teaching procedures for another part of the time. Other 
programs were stretched to last longer tiian the allotted time in order to 
enable teachers to spend part of the time performing, serving as "director 
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of learning" - , father than the program serving In this capacity, The Jus- 
tl fleet ion made by the teachers for these innovations vas that the students 
wanted more interaction with their instructors* 

It can be seen that the program replaces the teacher in the role 
of "director of learning, 11 and the net effect of the innovations or changes 
introduced by the teachers and administrators was to modify programmed in- 
struction in such a way that it took on more of the characteristics of 
regular classroom instruction, and permitted them to recapture some aspects 
of the role they wished to fill. The inventions created by the teachers 
imply that if the logic of programmed instruction is to have its way in 
schools, a new definition of what teaching is aiust be conveyed. 



This term Is taken from Teaching Competence, a report by the 
Commission cm Teacher Education, San Francisco: California Teachers 
Association, 1957, where it is used to signify the main function of teachers 
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Summary 



Programmed Instruction has an Impact on a school system beyond its 
impact on student achievement. In this chapter three areas illustrating 
such impact have been discussed. Through interviews with teachers and ad- 
ministrators involved with programmed instruction, it was found that pro- 
grammed instruction introduces elements into the teaching situation which 
render the standard methods of classroom observation of teachers by prin- 
cipals inadequate. Programmed instruction also permits students to move 
through their learning tasks at widely varying speeds. Faced with this 
situation which is defined as desirable by educators, practices emerged 
which successfully reduced the variability in student progress. Programmed 
instruction also replaces the teacher as "director of learning" and, 
having the apparent need to perform, teachers introduced their own in- 
novations which enabled them to recapture some of the role of "director 
of learning" which was lost to the program. 
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PILOT STUDIES OF THE INDIVIDUALIZED CLASSROOM 
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CHAPTER 4 

THE USE OF PROGRAMME!) MATERIALS 
TO INDIVIDUALIZE AND EXTEND INSTRUCTION 

1 

Jams R. Hawker and Robert Glaser 
Introduction 

TWo main findings of the studies described in Part One have been 
that (1) students proceed through the material at widely divergent paces— 
with many students able to proceed at a pace more rapid than that permitted 
by conventional classroom practices; and (2) a significant number of stu- 
dents know the materials to be taught before receiving instruction even 
though it is usually taught at a particular grade level* These results 
suggest that an important need in the improvement of classroom instruction 
is the development of procedures which more precisely determine what a 
student knows when he comes into the instructional situation* and a pro- 
cedure for adapting the instructional sequence to his particular require- 
ments* Such techniques* of course* Involve the development of procedures 
for the individualisation of Instruction* and represent an area in which 
programmed instruction might be used* Consequently* the research program 
for the 1963-44 academic year was oriented toward carrying out a series 
of pilot studies designed to increase the individualization of instruction* 
and* at the same time* to provide opportunities for extended learning* In 
an attempt to adapt the pace of instruction to the individual student* pro- 
grammed instructional materials were utilized at various grade levels with- 
in a classroom structure that was revised in order to permit a flexible 
teaching situation* More specifically* a series of five studies were 
carried out in the third* fourth* and fifth grades to evaluate individuali- 
zation procedures in the teaching of spelling and various arithmetic topics 
In addition* a sixth study was carried out at the fifth grade level in 
which programmed materials Here used as a tool for Individualised review 
of fourth-grade material before entering into new fifth-grade work. 

* * • * 

^Now at the Austin State School and The University of Texas* Austin 



Texas* 



136 



Techniques for Providing Individualisation 

The general procedure followed in these studies was to provide care- 
fully selected programed materials in specific subject matters , to struc- 
ture the classroom situation so that the student could work through the 
materials at his own pace, and to permit the student to by-pass those por- 
tions of the programmed material which pretest performance measures Indicated 
he already knew. This was accomplished by dividing the material into small 
teaching units and providing detailed pre- and postteata to assess the stu- 
dent’s mastery of the material within that unit. Then, before beginning 
work on one of the units in the program, the student would take the unit 
pretest and if his score were above a predetermined criterion, he was al- 
lowed to skip that unit of material entirely and proceed to the next unit. 

If his score were below the criterion, he was required to work through part 
or all of the unit, and, upon completion of the work, to again taka the unit 
test. The criteria used for determining progress from unit to unit were the 
following: 

1. 90% and above— considered mastery level. The student will 
proceed to the next unit test. 

2. 80-90Z— some additional work suggested within the unit. 

The student may qualify to go on to the next unit of work 
as his posttest score indicates. 

3. 50-79%— extensive work to be done within the program. 

The student should do all of the frames, kemedial work 
to be emphasised. 

4. Below 50%— lower grade work to be instituted. Tutorial 
and remedial work to be emphasised. 

Thus, the student was allowed to progress through the material at his own 
pace and was not required to spend time on the material which he already 
knew. By allowing the student to by-pass that portion of the material in 
which he indicated mastery, he was able to go on to more advanced topics in 
which he did need instruction. In this way, it was possible to individualise 
the instruction to soma extent for each student, and to provide an oppor- 
tunity for extended learning in a particular topic. As the studies proceeded, 
it became apparent that many of the students were completing the programmed 
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materials ahead of schedule and that there was a need for advanced work in 
particular topics. As a result* it was necessary for the staff to develop 
supplementary self-teaching materials so that the individualization pro- 
cedures could be continued. Using conventional textbook and workbook mate- 
rials » short teaching units were developed on particular topics* appropriate 
portions of the text or workbook were identified* and the material was set 
up so that the student could work on It alone or with minimal help from 
the teacher. Thus* while these materials did not constitute "programmed 11 
Instruction in the strict sense of the word* they did permit the students 
to continue with a program of Individualised instruction. 

Design and Evaluation of Studies 

The remaining portions of this chapter will discuss each of the 
studies in detail; however* all of the studies were quite similar in design 
and in experimental procedure. Groups of students received the individual- 
ized programmed instruction as part of their regular curriculum. Unless 

# 

otherwise dictated by the particular experimental design* each group of 
students receiving programmed instruction was matched with a similar group 
of students receiving conventional instruction and who served as a Control 
Group. The matching of groups was done on variables such as IQ and academic 
achievement levels* using data collected by the school system at the begin- 
ning of the year. In addition* a battery of tests was selected for each 
grade level and these were given both as pre- and posttests to assess and 
compare the achievement of the Experimental and Control Groups. Finally* 
detailed records were kept on the Experimental students' progress through 
the program* e.g.* amount of time worked in each unit* amount of material 
covered* etc. 



Individualised Instruction in Spelling 



To follow up the studies described in Chapter 1* two studies were 
carried out in spelling instruction. In the firif study* interest was di- 
rected toward moving the spelling program* considered to be fourth-grade 
work* to the third grade level. Since the earlier study had indicated that 
many fourth-graders knew the material before beginning the program* it was 
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f«l€ that perhaps the program coaid profitably be used by selected third- 
grade students • In the second study , the program was again given to fourth- 
grade students to see If the Individualisation techniques would be more ef- 
fective than the paced technique used previously* 

Third-Grads Snolllne 

TWo third-grade classes (total N-66) served as the Experimental 
Group and received Individualised spelling Instnsetlon using a programmed 
textbook, while two additional classes (total N-39) served as a Control 
Group and received traditional Instruction In spelling. An attempt was 
made to match the two groups as closely as possible on IQ and achievement 
level; however, the classes came from two different schools and It was not 
possible to natch them In the present study. Table 4.1 presents summary 
data for the two groups on several standard tests given at the beginning 
of the study. The groups did not differ significantly In IQ (t-1.63, 
df*103 t) £>*05)» but on the achievement tests, the Control Group was. In 
all eases, superior to the Experimental Group. Thus, students In the Ex- 
perimental Group were somewhat behind those In the Control Group In achieve- 
ment level at the beginning of the study. 

Materials. Students In the Experimental Group were given « pro- 
gramed textbook to be used for their spelling instruction. This program 
contains approximately 3,000 frames divided Into 12 teaching units. Within 
the program, the student Is required to spall a total of 447 complete words, 
plus significant parts of hundreds of other words. In addition, the pro- 
gram provides Instruction In phonies, syllabication, plurallsatlon, suffixes, 
prefixes, the use of words in sentences, and so on. As the study progressed. 
It was found that many students were moving quite rapidly through the pro- 
gram, and additional material was needed to continue the Individualisation 
techniques. Center staff members and the classroom teachers worked to- 
gather and developed supplementary materials using the Multi-level Speller. 
This book contains approximately 3700 words and Is Intended for Instructional 
use with grades 3 through 12. There are 183 lists grouped Into eleven 
spelling levels of Increasing difficulty, but the levels do not correspond 
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■ Table 4*1 

Summary Data on Standard Intelligence and Achievement Testa 
Given at the Beginning of the Year to Students In the 

Third Grads Spelling Study 



Experimental 

Group 

(N*66) 



Control Group 
Group Comparison 
(N-39) 



Test 


X 


SB 


X 


SB 


JE 


Otis Quick Scoring Mental 
Ability Test (IQ) 


117.52 


12.72 


113.90 


9.59 


1.63 


Metropolitan Achievement Tests: 


Battery Median Grade Equivalent 


3.72 


0.70 


4.11 


0.59 

,, O 


-3.02* 


Metropolitan Achievement Tests : 


Average leading. Grade Equivalent 


3.71 


0.78 


4.15 


0.57 


-3.31* 


Metropolitan Achievement Tests: 


Spelling Grade Equivalent 


3.90 


0.86 


4.41 


0.68 


-3.37* 


Metropolitan Achievement Tests: 
Spelling Test 


25.23 


4.48 


27.82 


3.71 


-2.80* 



*p < *01 



with particular grade levels. In addition* each spelling level 
placement test g consisting of a sample of 20 words from that level 9 which 
can be used to determine the point at which the student should begin work. 
Since primary interest in the present study was focused on determining 
the extent ^to which these students aonld pursue advanced materials, 'and.'" . 
not simply to see how many '(-additional words they oould leam 9 it was de- 
cided that , ooly ths placement lists wodld be sasd in developing the *up- 
plsmantary materials. Thus » unlts wars w^elkOd due on tha slsven place* 
mant lists making a total of 220 additlonal words available for study. 



! :X:' 



" O 

ERIC 

m S3 ' 



: ‘v. ■. 

■ / > . , ■ ■' .5 ? " *. ■ v " v;- •••■-,. . : - - ■ 

* t j .-/'I , < ' 

■ V: -- ".v.; 



' V. 






: v i 



\ 

■ ' \ .. . 



~r- : ■ 




. .1 



' . ■ >'■ 

y ; 






' %ic¥-ky? . ' ■■ QtX.)* y£Wf:z^£(i.- ':r 



140 



Sttidmitt in th« Control Group rtecivtd conventional elasirooa in- 
struction in spelling using regular third-grade spelling textbooks and 
class exercises conducted bp the teacher. 

Procedure. At the beginning of the school year, a battery of diag- 
nostic and achievement tests in spelling and language was given to both 
groups of students to determine spelling achievement. On the basis of 
these pretests and teacher evaluations, those students in the Experimental 
Group who appeared ready for the fourth-grade spelling program mere per- 
mitted to begin mork immediately with the programmed materials and mere 
sent to another room which mas supervised by a teacher and a teacher-aide 
during the regular spelling period. Those students whose pretest data in- 
dicated that they needed some remedial mork remained in the regular spelling 
class until they had overcome their deficiencies and then went into the pro- 
grammed material. Thus, all students in the Experimental Group did cot 
begin mork in the program at the same time, but began when their performance 
level indicated they mere ready to profit from individualised instruction. 

As the students completed the programmed materials, they returned to their 
regular class and began work in the supplementary materials. 

Students in the Control Group received traditional spelling instruc- 
tion in the regular classroom, and the teachers mere told to follow their 
usual teaching practices using any materials which they felt mould be bene- 
ficial. 

lesults and Discussion. All students mere again given the above 
battery of tests at the end of the year, and summary data on the pee- and 
posttest scores are presented in Table 4.2. These data indicate that, 
except for the Spelling Program Test, the Control Group scored signifi- 
cantly higher than the Experimental Group on all of the tests at the begin- 
ning of the study. However, the poetteet scores indicate that the two 
groups did not differ significantly at the end of the year. In terns of 
gain scores (i.e., the increase f re* pre* to posttesting), this means that 
the Experimental Group showed -much higher gains on all of the tests (see 
Table 4.2), and, in fact, all of these gain scores except thoae on the 



141 



prograa test wn statistically significant. Thus* the use of progranaed 
aaterials enabled the students to overcoat their initial deficiencies and 
to raise their general perforaance level considerably. 

In addition to the tests need for pro* and posttesting , another 
test was developed to provide a aeasnre of a vide range of spelling achieve* 
sent for all students in the spelling studies. The test consisted of 120 
words selected froa the New Iowa Spelling Scale and represented a saapling 
of words froa each grade level froa grade three through eight. Twenty 
words were selected froa each grade level and were words which had been 
correctly spelled by approxiaately SOT of the students in the standardise* 
tlon saaple used in developing the ecale. Thus the list at each grade 
level consisted of words of asdlua difficulty. The groups were coapared 
on each list and on the total nuaber of correct iteas and were approsl* 
aately equal on all lists except the Grade S list where the Bxperiasntal 
Group scored higher than the Control Group (t«1.99» df;*103, £<.05). The 
Bxperiasntal Group also had a higher aean nuabot of iteas correct on the 
total list* but the differences were not large enough to be statistically 
significant (sae Table 4.2). 

In addition to the test data* records were kept of the aaount of 
tine required by each student in the Bxperiasntal Group to eoaplate the 
prograa and the distribution of these data is presented in figure 4.1. 

As the figure shows* the fastest students were able to coaplete the entire 
prograa within 31 to 40 days* while the slowest students required 131 to 
^410 days for coapletlon {2*78.44* SHL72). Thus* it can be seen that 
the individualisation procedure greatly accentuated the individual differ* 
eases in learning rate aaong the students. 

It is also of interest to nonpars the aaount of notarial covered 
by the Bxperiasntal and Control groups* The Control Group worked for the 
entire year (a p proxiaately 180 school days) in their regular spelling text* 
book which introduced 337 new words (coopered with 447 in the progressed 
text)* as well as the other aeterial on phonics* syllabication* ate. Thus* 
if one looks at the aaount of notarial covered and the aaount of tins 
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•P«nt, it can ba saan that tha aaa of programmed materials permitted stu* 
dents to cover approximately 25% more aatarial In an average tiaa , laas 
than half of that required by students receiving conventional instruction. 
Also, atudanta in tha Experimental Group vara gives! advancad work in tha 
Multl-I«evel Spallar aftar thay finiahad tha program* This aatarial 9 it 
will ba recalled, eonaiatad of eleven 20-word liata of ineraaaing diffi- 
culty* Figure 4*2 givee tha percentage of atudanta successfully completing 
tha various lists along with cumulative number of words mastered* (In 
tha Botel book, A through K roughly corresponds to grade levels 3 
through 12*) As tha figure indicates, many studanta ware able to complete 
a number of additional liata so that tha total number of words mastered 
was considerably above that of tha Control Group* 

Thus, these data seam to indicate that tha individualised use 
of programmed materials for spalling Instruction was quite affective with 
tha present group of third-grade students* Tha students showed higher 
gains than tha Control Group on all of tha achievement tests, and covered 
considerably more material in the allotted time* In addition, the extent 
to which the Experimental Group students "spread" themselves out suggests 
that the average student can cover a greater amount of material than is 
possible in the conventional classroom, and that even the slower students 
are able to cover a prescribed amount of material in less time than normal- 
ly required in the intact classroom* 

Fourth-Grade gnellina 

Fifty students from two fourth grade classes constituted the 
Experimental Group, and 5G students from two other classes served as a 
Control Group* (Unfortunately, however, a large number of students in the 
Control Group were absent for extended periods of time due to an epidemic 
of measles and mumps In the school so that the records for these students 
were not complete for many of the tests which were given* Twenty students 
fell into this group so that the final else of the Control Group was 30 
subjects, and only these stibjects were used in making comparisons between 
the two groups*) The two groups were matched on IQ and general achievement 







i 



o 

ERIC 



143 



Table - 4*2 

Sunnary Data on Pra- and Poetteate for Studenta 
in the Third-Grade Spalling Study 



Taat 




Experimental 

Group 

(H-66) 

X SB 


Control 

Group 

(N-39) 

X SD 


Group 

Coaparlaon 

t. 


Spalling for Word Maatary 


Pra 


13.98 


10.90 


20.77 


11.42 


-2.96** 




Poat 


33.92 


6.03 


35.23 


a 


-0.99 


(40 Itaaa) 


Gain 


19.94 


7.77 


14.46 


8.52 


3.25** 


Metropolitan Achievement 


Pra 


13.94 


11.66 


20.62 


10.60 


-2.97** 


Spalling Taat 


Poat 


31.41 


8.26 


32.28 


7.24 


-0.56 


(40 itana) 


Gain 


17.47 


8.09 


11.66 


5.78 


4.15** 


Iowa Daaic Skill*: Spalling 


Pra 


14.98 


6.85 


17.82 


6.07 


—2.18* 




Poat 


24.05 


4.67 


24.44 


4.78 


-0.40 


(30 Itaaa) 


Gain 


9.07 


5.82 


6.62 


3.77 


2.58* 


Spalling Prograa Llat A 


Pra 


10.45 


5.52 


12.79 


5.61 


-2.05 




Poat 


23.06 


5.31 


19.77 


5.29 


3.04** 


(30 Itaaa) 


Gain 


12.61 


3.64 


6.98 


3.03 


8.46*** 


Spalling Prograa Llat B 


Pra 


10.39 


6.72 


14.51 


6.15 


-3.17** 




Poat 


22.45 


5.64 


21.79 


5.02 


0.61 


(30 itaaa) 


Gala 


12.06 


3.58 


7.28 


3.67 


6.39*** 


Spalling Prograa Taat 


Pra 


31.21 


7.37 


28.87 


7.38 


1.55 




Poet 


42.771 


8.22 


40.44 


1163 


1.25 


(69 itaaa) 


Gttin 

W0r. „ - 


. ,11.561; 


: 6.71! 


11.57 


7.88 


0.14 


Iowa Spalling Settle llat 


"'-f'.-TVR ~ * 


' ' . , ■' 


V — ItSr 




ZXrp&y 1 -v ' 


...v - 


V%«tv ■‘ertyPi '■ h ^ « 


Total 


:|60.64§ 

Vr '%# 


19.92 


58.85 


19.18 


0.45 
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*ap| .Ol(two-tailedtettfe) 
***P < .001 (two-tailed iart) 
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31* 41- SI* SI* 71* SI* §1* ill* 111* 121* 131- 141* 151- 
44 St If 78 §1 98 Itt lit 128 139 148 ISO 160 

DAYS TO COMPLETION 



Figure 4*1 Nunbcr of dsys to couplet* spelling progr&n by 
third»grade students (N*66) » 




tutorial: 


fro* 1 


r ilsP 


' Ust 1 


1 Ust 1 


1 list 1 


1 Ust 1 


1 Ust 


* List 


' Ust 1 


1 list 1 


" Ust 


* list 


gram 


A 


8 


8 


8 


I 


f 


8 


a 


1 


1 


R 


No. Words: 


447 


n 


2# 


21 


28 


28 


28 


28 


28 


28 


28 


28 


Cum. No. Words: 


447 


487 


487 


M7 


827 


847 


887 


887 


4t7 


827 


847 


887 



Figure 4*2 Percent of tbird-grsde students conpleting 
spelling progrsn end sdranced neteriel in 
spelling (M-44). 
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tests and, evtQ with the reduction in the size of the Control Group, the 
groups did not differ significantly on any of the measures (see fable 4*3) • 
Thus the groups began the study with equal achieveaent in spelling and 
language subjects* 

Materials , The same aaterials outlined in the third grade study 
were used in the present study* Students in the Experimental Group re- 
ceived the Spelling Program, and when completing it, moved into supple- 
mentary material developed fro* the Multi-Level Speller* Students in the 
Control Group used the regular fourth grade spelling textbook and any 
other aaterials which the teachers wished to use* 

Procedure* The general procedure was essentially the same as that 
used with the third grade* Both groups were given the battery of diag- 
nostic ard achieveaent tests at the beginning of the year and then went 
into spelling instruction* Students in the Experimental Group began work 
inaediately in the prograa and* utilizing the individualization technique 
described previously, worked through the prograa on an individual basis 
and at their own pace* As they finished the prograa, they began working 
in the Multi-Level Speller* Unlike the procedure in the third grade, how- 
ever, the students in the fourth grade Experimental Group were required 
to work through all of the lists in the Multi-Level Speller* That is, 
instead of working only on the placement tests at each of the 11 levels, 
the student would work through all of the lists at each level* Before 
beginning work on a particular list, the student was tested on it and if 
his score was sufficiently high (i*e*, above the 90% correct criterion), 
he was considered as having mastered that list and went on to the next 
list* If his score was not above criterion, he was given exercises in- 
volving the words he had missed, and then would take the test again* 

Thus, the same procedures were used for the supplementary work as for the 
prograa work* 

The Control Group again received traditional spelling instruction 
in its regular dassseea using textbooks and other conventional materials* 
At the end of the year, both groups were given the various poettesta and 
the spelling grade range teat which was developed and described in the 
previous study* 
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Table 4.3 



Summary Bata on Standard Intelligence and Achievement Testa 
Given at the Beginning of the Tear to Students In the 
Fourth Grade Spelling Study 



Experimental Control Group 

Group Group Comparison 

Test (M-66) (N-39) 





X 


SB 


X 


SB 


Jt 


Otis Quick Scoring Mental 
Ability Test 


111.36 


13.08 


114.80 


14.40 


-1.05 


Metropolitan Achievement Tests: 
Battery Median Grade Equivalent 


4.89 


0.90 


4.70 


0.82 


0.96 


Metropolitan Achievement Tests: 
Average Beading Grade Equivalent 


4.81 


1.18 


4.47 


\ 

0.89 


1.41 


Metropolitan Achievement Tests: 
Spelling Grade Equivalent 


5.21 


1.05 


5.33 


1.12 


-0.47 


Metropolitan Achievement Tests: 
Spelling Test 


30.52 


7.49 


31.37 


7.18 


-0.50 



Insults and Bltcuaslom . The pre- and posttest data for each group 
are presented in Table 4.4, and indicate that the two groups did not differ 
significantly on any of the pretests except the Spelling Program Test on 
vhlch the Experimental Group had a higher mean score (jt*2.81 f df«78» £<*ul) . 
Similarly , the groups mere essentially equal on the post tests with the ex- 
ception again of the Spelling Program Test , but this tlne 9 the order of the 
means was reversed— that is, the Control Group had a higher mean score than 
the Experimental Group df»78. £<*01). The Experimental Group 

did soore higher than the Control Group on the spelling grade range test 
(means of 71.16 and 66.27, respectively}, but the difference mas not suf- 
ficiently large to indicate a reliable difference in the performance of the 
two groups (gf»0.93, dft»78. g).05)« 
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Table 4.4 

Suanary Pata on Pro- and Poatteata for Studanta in the 

fourth Grade Spalling Study 



Experimental Control Group 

Group Group Coepariaon 

(K-50) (H-30) 







1 


SO 


1 


SO 


1 


Spelling for Word tfeatery 


Pre 


35.64 


10.62 


32.17 


10.11 


1.44 


Poat 


43.88 


6.96 


46.20 


5.07 


-1.69 


(40 iteea) 


Gain 


8.24 


5.74 


14.03 


8.07 


3.41** 


Stanford Achievement Teat 


Pre 


38.18 


8.88 


37.13 


7.30 


0.56 




Poat 


44.20 


5.37 


44.63 


5.32 


-0.35 


(40 iteea) 


Gain 


6.02 


4.84 


7.50 


4.09 


1.51 


Iowa Baaic Sicilia : Spelling 


Pre 


22.10 


5.64 


20.40 


4.69 


1.43 


Poat 


26.56 


3.51 


26.43 


3.14 


0.16 


(30 iteea) 


Gain 


4.46 


3.69 


6.03 


4.54 


2.11* 


Spelling Progran Liat A 


Pre 


18.42 


4.76 


17.20 


4.55 


1.12 


Poat 


23.78 


5.17 


24.33 


4.00 


-0.53 


(30 iteea) 


Gain 


5.36 


2.52 


7.13 


2.86 


2.92** 


Spelling Program Liat B 


Pre 


20.38 


6.12 


18.30 


6.29 


1.43 


Poat 


24.66 


4.54 


25.70 


4.67 


-0.96 


(30 iteea) 


Gain 


4.28 


3.36 


7.40 


3.57 


3.68*** 


Spelling Prograe Teat 


Pre 


35.56 


10.10 


28.73 


10.54 


2.81** 


Poat 


44.08 


9.17 


50.50 


10.63 


-2.71** 


(69 iteea) 




8.52 


6.63 


21.77 


6.99 


7.99*** 


Iowa Spelling -Seale liat 


(120 iteea) 


Total 


71.16 


24.59 


66.27 


21.02 


0.93 



*p < *05 (two-tailed teat) 
**p < .01 (two-tailed teat) 
***p < .001 (two-tilled teat) 
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The failure of the two groups to reflect any differences in poet- 
test performance ia somewhat pussling, and the fact that the Control Group 
scored higher than the Experimental Group on the Program lest is especially 
so* In the previous study, reported in Chapter One, with fourth-grade stu- 
dents, it was found that while the Experimental and Control groups did not 
differ reliably on standardised tests such as the Iowa Spelling Scale and 
the Stanford Achievament Test, the Experimental Group did score signifi- 
cantly higher than the Control Group on the Program posttest* The reason 
for this discrepancy in results is not clear at the present time* 

Although the test results do not reflect any differences in end- 
of-year achievement level, it is interesting to examine the differences in 
rate of learning among subjects in the Experimental Group and the Control 
Group* Figure 4*3 presents the distribution of students in the Experi- 
mental Group completing the program in different numbers of days, and the 
wide variability in the amount of time required to complete the program 
can again be noted* Pive of the students finished the program within 21 
to 30 days while the slowest two students required 121 to 130 days with 
the mean number of days required by all students being 86*02 days (SD»31*81) . 
As in the previous study, the Control Group worked the entire school year 
of 180 days during which tins they received 470 new words in their text- 
book* Thus, the two groups covered approximately the same amount of mate- 
rial, but the Experimental Group completed it in an average time almost a 
third of that worked by the Control Group* Moreover, students in the Ex- 
perimental Group completed a large number of lists in the supplementary 
material, as is shown in Figure 4*4* This figure shows the number of words 
in each spelling level as well as the total number of words mastered by 
various percentages of students* For example, almost SOX of the students 
covered an additional 1,487 new words— approximately three times the num- 
ber covered by the Control Group* Thus, although the achievement test 
scores did not reflect significant differences in the performance of the 
two groups, these data Indicate an impressive difference in the amount of 
material covered by the two groups* 
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DAYS TO COMPLETION 

Figure 4*3 Number of days to complete spelling program by 
fourth-grade students (N*5Q) • 





No. words: 447 •• •• 144 2M 244 416 444 444 444 7H HI 

Cm. No. Words 447 147 • 8S7 417 S87 1417 1447 1447 2247 2847 3847 4487 

»< • • 

Figure 4.4 Percent of fourth-grade students completing 
spelling program and advanced material in 
spelling (3 a 50) . 
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Finally , it if Interesting to cospare the rate of learning for the 
two Experimental Groups in third and fourth grade. Figure 4.5 presents 
the cumulative percentage of students finishing the progressed work in dif- 
ferent numbers of days and indicates that there was a good deal of overlap 
between the two grades. As would be expected, the fourth grade students 
completed the program in significantly less time than the third grade stu- 
dents (t»2.37, df»114, £4*05); although , many of the third-grade students 
completed the program in less time than some fourth graders, these results 
underscore the previous finding that sany students can successfully pursue 
a course of instruction in a topic customarily set at a higher grade level. 

Summary of the Spelling Studies 

Taken together , the results of these two studies indicate that pro- 
grammed materials can be effective tools for individualisation. In both 
studies , students using the programs completed comparable amounts of mate- 
rial in less time than students receiving conventional instruction, and 
consequently were able to go into advanced work not normally available to 
them at their particular grade level. Moreover, the extent to which the 
Experimental Group students spread themselves out implies that the average 
and above-average student can cover a considerably greater amount of mate- 
rial than is possible in the conventional classroom, and that even the 
slower students may be able to cover a prescribed amount of material in 
less time than normally required in the classroom. 

Finally, the achievement test data at the end of the year indi- 
cated, with few exceptions, that students in the programed classes reached 
a final achievement level equal to or above that of students in conven- 
tionally taught classes , even though they had spant less time in soma of 
the topics than the control classes..: ' 

Individualised Instruction in Arithmetic 

- ■ < " .■ • 

A second set of studies was concerned with individualising and 
extending arithmetic instruction at the third, fourth, and fifth grade 
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levels* In the first study In this series 9 e selected group of third-grade 
students received a progqpa in nultiplication and division a topic which 
is usually considered fourth-grade level work* Although nultiplication and 
division are usually introduced in the third grade 9 the topic is generally 
designated as a content area to he developed fully in the fourth grade* 
Thus* the prohlea was to determine whether advanced third-grade students 
could profitably pursue advanced work in this topic* The second study was 
designed to extend the findings reported in Chapter One in which progressed 
aaterials were used in the fourth grade to extend arithaetic instruction* 
That study had indicated that fourth-grade students could profit fron ad- 
vanced work in arithaetic topics 9 and the present study was designed to 
ditissis* if additional gains could he realised when the students were 
pernitted to advance on their own* The final study in this series was 
conducted at the fifth grade level and was 9 in part 9 an extension of the 
fourth grade study conducted in the previous year (Chapter One)* The 
aajor concern of this follow-up study was to detemine whether or not 
those students who had been accelerated last year naintalaed any super- 
iority or reached a higher level of achieveaent than groups proceeding st 
a aore noraal pace* 

,- t „ . • «. 

Third-Credo Arithaetic {Multiplication and Division) 

At the beginning of the school year 9 two third-grade classes were 
designated to be used as Sxperiaental Croups* Then* at the beginning of 
the second sense ter 9 teachers in the two classes adalslstered a series of 
diagnostic and achieveaent tests to all the students in their classes • 

Those students whose achieveaent test scores indicated that they could 
profit froa advanced work in nultiplication and division were selected 
fron the two classes and served as the Sxperiaental Group (total 11*34) • 

Two additional classes 9 tilth a total of 56 students 9 eoaprised a Control 
Group* Since the students in the Sxperiaental Group were selected on the 
basis of high achieveaantt it was not possible to natch the Sxperiaental 
and Control groups* Table 4*5 presents suanary data on IQ and standard 



